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Numerous lines of experimental, numerical and analytical evidence indicate that it is surprisingly 
easy to locate optimal controls steering quantum dynamical systems to desired objectives. This 
has enabled the control of complex quantum systems despite the expense of solving the Schrodinger 
equation in simulations and the complicating effects of environmental decoherence in the laboratory. 
Recent work indicates that this simplicity originates in universal properties of the solution sets to 
quantum control problems that are fundamentally different from their classical counterparts. Here, 
we review studies that aim to systematically characterize these properties, enabling the classification 
of quantum control mechanisms and the design of globally efficient quantum control algorithms. 
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I. INTRODUCTION 

The notion of controlling quantum systems seems in- 
herently problematic on several counts. First, the ex- 
treme sensitivity of quantum systems to environmental 
interactions would appear to place limits on the maxi- 
mal achievable control fidelity. Second, from a numerical 
perspective, given the considerable cost of propagating 
the Schrodinger equation, unless the search space for 
optimal controls has particularly simple properties, it 
would appear impossible to locate controls for all but the 
smallest quantum systems in reasonable time. However, 
once the methods of optimal control began to be applied 
to molecular systems (thanks to remarkable advances in 
laser pulse shaping technology) it rapidly became clear 
that quantum control was not an ill-fated concept, but 
rather, that controlling quantum systems was surpris- 
ingly easy. In the laboratory, this conclusion was partic- 
ularly apparent in the case of so-called adaptive learn- 
ing control of quantum dynamics, wherein learning (i.e., 
typically genetic) algorithms are applied to search the 
space of laser control parameters for the maximization 
of the expectation value of a quantum observable. This 
search space is high-dimensional, normally suggesting 
that it should be replete with local optima and other 
unfavorable features that would trap unsophisticated 
search algorithms, especially in the presence of environ- 
mental decoherence. The repeated successes of quantum 
optimal control experiments and simulations indicated 
that the so-called " curse of dimensionality" , common in 
the theory of optimization in high-dimensional spaces, 
was not prohibitive here. 

This attractive circumstance for quantum control 
rests on the mathematical underpinnings of quantum 
theory being surprisingly simple, owing to the linearity 
of quantum mechanics and the unitarity of the accom- 
panying transformations. Although quantum systems 
can be highly sensitive to environmental perturbations, 
the rules governing their dynamics are in many ways 
simpler than those governing classical dynamics. Fur- 
thermore, the presence of an environment, rather than 
being an impediment, may under the right conditions aid 



the control process. Recent work has aimed to under- 
stand the precise mathematical properties of quantum 
mechanics are responsible for the surprising simplicity 
with which quantum phenomena can be controlled. An- 
alytical, numerical and experimental treatments of the 
problem have been explored. In order to enable the sys- 
tematic study of these features, the notion of a quantum 
control landscape, defined as the map between the space 
of time-dependent controls and associated values of the 
objective functional, was introduced (Figs. [Tl[2]). 

From an analytical perspective, it was recently found 
that for several classes of low-dimensional problems, it is 
possible to exactly solve for quantum optimal controls, 
without any need for numerical search. By contrast, 
for the analogous classical problems, analytical solutions 
do not exist. Of course, analytical solutions are still 
only possible for special small systems; however, beyond 
this, it has become clear that the numerical or exper- 
imental search for optimal controls is often easier for 
quantum systems than for classical systems. In this re- 
gard, the topology of the search space is of fundamental 
importance. Evidence suggests that the landscapes for 
both observable maximization and control of dynamical 
transformations have simpler topological properties for 
quantum versus classical systems, contributing to rapid 
convergence of numerical or experimental searches for 
effective controls. Moreover, besides the simplicity of lo- 
cating quantum controls, it has been observed that the 
controls themselves have remarkably simple functional 
properties, in some cases enabling a direct interpreta- 
tion of the mechanisms involved in steering about the 
dynamics. 

The ease of locating optimal quantum controls, and 
the comparatively simple structure of these controls, 
have pervasive implications for a wide range of quan- 
tum technologies. The study of quantum control land- 
scapes is motivated by the practical goals of achieving 
higher objective function yields and designing control 
fields with desired properties, but in order to attain 
these goals, it is necessary to embrace the mathemat- 
ical framework that underlies the remarkable properties 
of these landscapes. The origin of these counterintuitive 
properties, and their differences with respect to classical 
control, constitute the primary subject of this review. 

The review is organized as follows. In section II, we 
examine the topology of solution sets to quantum ob- 
servable and unitary transformation control problems. 
Section III reviews the analytical solutions obtained for 
low-dimensional quantum control problems. In section 
IV, we consider numerical studies of the solution sets to 
higher dimensional quantum control problems without 
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FIG. 1: A control landscape is defined as the map between the time-dependent control Hamiltonian and associated values of 
the control cost functional. The entry point into their study is (a) the controllability of the quantum system, which allows 
search algorithms to freely traverse the landscape. Quantum control landscape features can be conveniently subdivided into 
those pertaining to (b) critical topology, i.e., the maxima, minima and saddle points of the landscape, and (c) landscape 
geometry, namely the characteristic local structures encountered while climbing toward the global optimum. Study of the 
geometry of quantum control landscapes reveals (d) the existence of multiple control solutions corresponding to any given 
objective function value. The topology and geometry of quantum control landscapes together determine (e) the search 
complexity of the control problems, i.e. the scaling of the effort required to locate optimal controls. An ultimate goal in 
the study of quantum control landscapes is the design of global search algorithms that attain lower bounds on this search 
complexity. Such algorithms may be applied to either of the two major classes of quantum system manipulation problems, 
(f) control of quantum observables and (g) control of quantum dynamical transformations (i.e., unitary propagators). An 
overarching conclusion pertaining to both these types of landscapes is that they contain no suboptimal traps, which has 
broad-scale implications for both the experimental and computational feasibility of quantum control. 



analytical solution, focusing on the degeneracy in the 
set of controls that reach the same objective. Then, sec- 
tion V reviews experimental work that has probed the 
structure of these level sets of multiple solutions, as well 
as the topology of quantum control landscapes. Section 
VI examines how the controllability of quantum systems, 
compared to that of classical systems, impacts control 
landscape properties, in particular with respect to search 



efficiency. In section VII and VIII, we review approaches 
to the quantification of quantum control search effort 
complexity and the design of global search algorithms 
that aim to attain lower bounds on complexity scaling. 
In Section IX, we consider the effects of quantum deco- 
herence on the structure of quantum control landscapes 
derived in previous sections. Finally, in section X, we 
draw conclusions and discuss future directions. 
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FIG. 2: Schematic representation of a quantum control landscape depicting various features discussed in the review. Xi,Xj 
indicate two of possibly many control degrees of freedom, and J denotes objective function value. A point on the landscape 
corresponds to a time-dependent control field, a) Critical points of the map correspond to locally optimal solutions to the 
control problem. The number of positive, negative, and null Hessian eigenvalues at these points determine whether they are 
saddle points or local traps (Section II). In the most common case of state-to-state population transfer, there are no local 
optima and the global maximum is a continuous manifold, depicted in the picture as the solid curve. Level sets (b) of the 
control landscape correspond to control fields that produce the same objective function value at the final dynamical time T 
(shown as a dotted line). Any point on the landscape corresponds to a control field e{t), with one on the extremal manifold 
indicated. 



II. HAMILTONIAN-INDEPENDENT 
PROPERTIES OF SOLUTION SETS TO 
QUANTUM CONTROL PROBLEMS 

The most fundamental property of landscapes of so- 
lution sets to variational problems is their critical topol- 
ogy, i.e., the number of solutions, their associated func- 
tional values, and their optimality status (Fig. 1). In the 
context of optimal control theory, these critical points 
correspond to (possibly suboptimal) solutions of the op- 
timal control problem, including both global and local 
minimizers of the objective functional. 

An early work [l| explicitly explored the multiplicity 
of solutions to quantum optimal control problems aimed 
at the maximization of the expectation value of an ob- 



servable operator at a final dynamical time T. Through 
the application of a perturbation theory approach to the 
nonlinear variational equation, it was shown that in gen- 
eral, a denumerably infinite number of solutions (control 
fields) exist to such quantum control problems. More- 
over, multiple unitary propagators U(T) are typically 
associated with the various possible local and global op- 
tima of the objective. Recent work, discussed through- 
out this review, has aimed to identify how the infinite 
number of solutions to quantum optimal control prob- 
lems are distributed among the global and local optima 
of the control landscape. The optimality status of these 
solutions plays an important role in determining the 
performance of local search algorithms as they traverse 
the landscape. A remarkable feature of quantum opti- 
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mal control landscapes is that these properties can all 
be determined analytically for many problems of inter- 
est, whereas for general variational problems outside of 
quantum control, such information is exceedingly diffi- 
cult to acquire. Moreover, many of these properties are 
independent of the Hamiltonian of the quantum system. 

In this section we review work aimed at characteriz- 
ing the critical topologies of quantum optimal control 
problems. In the absence of additional information, it 
is natural to expect that the control landscape will pos- 
sess multiple local maxima and minima that are capable 
of trapping the search for optimal controls at subopti- 
mal values of the objective. We will show that in stark 
contrast to this generically expected situation, the crit- 
ical topologies of quantum optimal control landscapes 
are surprisingly simple. In what follows we consider a 
controllable (see Appendix lA 61 for a review of the defi- 
nition of controllability) quantum system of N discrete 
levels whose dynamics are driven by the Hamiltonian 
H = H [fl"o, {fffc}] , depending on a free Hamiltonian iJo 
describing the uncontrolled evolution of the system and 
an appropriate set {e^} of control variables (e.g., phases 
and amplitudes in an optimal control experiment (OCE) 
pulse shaper). 

A generic quantum optimal control cost functional can 
be written: 



J = $([/(T),r)- 



Re 



e{t))U{t) m dt 



Xl fieit))dt (1) 

'0 



where P{t) is a Lagrange multiplier operator con- 
straining the quantum system dynamics to obey the 
Schrodinger equation, e(t) is the time-dependent con- 
trol field, and A weights the importance of an auxiliary 
physically motivated penalty term on the field. This lat- 
ter penalty decreases the degeneracy of solutions to the 
optimal control problem; a common choice for in sim- 
ulations is where s{t) is the pulse envelope, 
corresponding to a penalty on the total field fluence. 
Other, even more general cost functions can easily be 
generated with alternate choices for as well as addi- 
tional terms involving the evolving quantum state. 

The two most common types of quantum optimal con- 
trol problems are the maximization of the expectation 
value of a Hermitian observable and the maximization of 



the fidelity of a quantum unitary transformation. Op- 
timizing the expectation value of a Hermitian observ- 
able operator describes a broad variety of problems in 
quantum control, such as performing selective chemi- 
cal fragmentation and rearrangement 0, Q , redirecting 
energy transfer in biomolecules [3], creating ultra- fast 
optical switches and tailoring high harmonic generation 
This problem corresponds to the following choice of 
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$i(C/) = Tr [U{T)p{0)U\T)e] , 



(2) 



where p(0) is the initial density matrix of the system, O 
is an arbitrary observable operator, and T is the final 
dynamical time. 

The optimal control of quantum unitary transforma- 
tions has recently received increasing attention due to 
its applications to the field of quantum information pro- 
cessing (QIP). Over the past several years, it has be- 
come clear that the physical implementation of logical 
gates in QIP, which are represented by unitary propaga- 
tors, maybe facilitated by optimal control theory (OCT) 
d, 0, H, Q. However, as we will see below, the optimal 
control of unitary transformations also has applications 
to population transfer in atoms and molecules. Within 
OCT, the problem of maximizing the fidelity of a dy- 
namical transformation W can be framed using Q: 



^2iU) = ^|I^y-C/.,(T)| = 



2N - 2ReTr [M^^C/(T)] 



(3) 

(4) 



where W is the target unitary transformation. 

Solutions to these optimal control problems corre- 
spond to the condition = 0. In this section, we 
assume A = 0, and show that under this assumption 
many properties of the critical points of the functionals 
$1 and <I>2 can be characterized analytically. An in- 
finitesimal functional change in the Hamiltonian 5H(t) 
produces an infinitesimal change in the dynamical prop- 
agator U {t, 0) as follows: 



U{t,t')SH{t')U{t',0)dt'. (5) 



It can be shown that for the objective func- 
tions $1 and $2 the respective changes in $ 
are = -Tr[ [e(T), p(0)] [/t(r, 0)(5C/(T, 0)] , where 

e(T) = [/(T)eC/t(T), and ^$2 = Ti[{WlU - 
U'<W)U^T, 0)SU{T, 0)] . In the special case of the elec- 
tric dipole approximation, the Hamiltonian has the form 
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H{t) = Hq — fi ■ e{t), where Hq is the internal Hamil- 
tonian of the system and fi is the electric dipole oper- 
ator. Then SH{t) = VeH{t) ■ 6e{t), W {T,0)SU{T,0) = 

-j- W{t, 0)VeH{t)U{t, 0) • Se{t)dt, and the gradients 
of the control objective functionals can be written: 



TT{[e{T),p{Q)]B{t)), 



and 



fe(t) 



= Tr {{W^'U - U''W)B{t)) , 



(6) 



(7) 



where B{t) = -j-UHt,0)'7eH{t)U{t,0), and we have 
adopted the shorthand notation U = U{T). Within the 
dipole approximation, B{t) = — (i, 0)/iC/(i, 0). 

The variational problems of optimal control theory 
admit two types of minimizers ^ . According to the chain 
rule, 



features of general quantum control landscapes. Because 
the map e{t) — » U (T) is locally surjective at these points, 
each of the matrix elements Upq must be uniquely ad- 
dressable by the control field e{t) for all p and q values 
in keeping with U being unitary, i.e., the set of func- 
tions should be linearly independent. Hence, the 
critical condition for normal extremal controls is equiv- 
alent to = for arbitrary ^f^- Moreover, it can be 
shown (see Appendix lA 1 a[) that the optimality status 
(i.e., minimum, maximum or saddle point) of a critical 
control field e{t) will be equivalent to that of the result- 
ing propagator U{T) on the unitary group U{N). The 
local surjectivity of e{t) U{T) has important con- 
nections to the controllability of the quantum system, 
discussed in sections VI and VII. In what follows, we 
provide expressions for the gradient and Hessian of the 
above objective functions on both the domain of control 
fields and unitary propagators, and use these results to 
characterize their critical topologies. 



dJ 5U 



SJ 



Se{t) dU Se(t) ■ 



(8) 



The first type of minimizer corresponds to those control 
Hamiltonians that are critical points of the control ob- 
jective functional, but are not critical points of the map 
between control fields and associated dynamical propa- 
gators (i.e., points at which fjj = 0, while the Frechet 
derivative mapping from the control variation Se(t) to 
SU{T) at t = T is surjective). The second type corre- 
sponds to critical points of the latter map (i.e., points 
at which the mapping from Se{t) to 5U{T) is not locally 
surjective) [l^l. In this section, we consider the first 
type of critical point, which are referred to as kinematic 
critical points or normal extremal controls. The second 
type, which are called abnormal extremal controls, are 
comparatively rare in quantum control problems, and 
we defer their study to section VII. 

The class of normal extremal controls is Hamiltonian- 
independent and captures the most universal topological 



^ In mechanics, the Lagrangian functional that determines the 
equations of motion is uniquely determined by symmetries of 
the system. However, in optimal control theory, the objective 
functional, which determines the control law, is chosen by the 
controller. This distinction lends an additional component to 
the study of the topology of optimal control problems, namely 
the topology of the map between dynamical propagators and 
associated values of the chosen objective function. 



A. Observable maximization 

In 1937, John von Neumann first addressed the crit- 
ical topology of a problem that has direct implications 
for optimizing quantum observables pH . [T3 | . Although 
it is unclear whether von Neumann anticipated the ap- 
plications of his work to quantum control, this paper 
may be considered the first work in the theory of quan- 
tum optimal control landscapes. This work was recently 
extended by several authors [H, [l3| . 

Within the electric dipole approximation, the gradient 
© can be explicitly written [l5|: 

^ = 4Tr[[e(T),p(0)]Mt)]^ 



^p,^[(^|e(^)|J)(JV(^)|^)-(^|M(^)|j)(J|e(^)|^) 



i=l J=l 



(9) 



where the initial density matrix is given as p{0) = 

Er=iP»l»)(«l'Pi > ••• > Pn > 0, Er=iP» = 1' and 
/i(t) = W{t)p.U{t). The local surjectivity of e{t) 
U (T) at normal extremal controls implies that the iV^ 
functions of time {i\iJ,{t)\j) are linearly independent. As 
discussed above, under this assumption the critical con- 
dition is equivalent to that on the domain of unitary 
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propagators, ^f- ~ 0. Because the gradient de- 
pends on the eigenvalue spectra of p(0) and 9, it is 
convenient to simphfy the analysis by investigating the 
critical topology on the domain U{N). Expanding the 
argument of the objective function hy U ^ U exp (iAs), 
where s parametrizes an arbitrary curve in the Lie al- 
gebra of U {N) in the direction A, the critical condition 
can be expressed as 



dU 



d4>i 



iTr(A [C/teJ7,p(0)]) =0. 



(10) 



The maximal subset of U (N) which satisfies this con- 
dition is composed of the matrices of the form 



Ui = QPiR^ 



(11) 



where Pi, Z = 1, • • • , iV! is an A^— fold permuta- 
tion matrix whose nonzero entries are complex num- 
bers e*"^!, ■ • ■ ,6*"^" of unit modulus, and p(0) = Q^eQ 
and Q = R^XR. ei, £2, £n and Ai, A2, Xn are the 
eigenvalues of p(0) and Q with associated unitary diag- 
onalization transformations Q and R, respectively. The 
critical set is the union of iV— torii |J; T^^ with each torus 
corresponding to a distinct permutation P; . 

The number of critical submanifolds corresponding 
to suboptimal landscape values scales factorially with 
system dimension for fully nondegenerate p(0) and Q. 
If p(0) and Q have arbitrary numbers of degeneracies 
Di, ...D„i, and Ei, En, respectively, it can be shown 
[Toj that the critical submanifold dimension on the do- 
main U (N) for a particular critical manifold Mk is 



Or 



(12) 



t=i 



where the oj's are the overlap numbers (numbers of 
overlapping elements) between the degenerate blocks 
Di, Dm and Ei, En, for the permutation matrix 
corresponding to that manifold. These degeneracies 
cause neighboring submanifolds to merge, and give rise 
to subspaces that are invariant to eigenvalue permuta- 
tions. If p(0) or is a pure state projector, the number 
of critical manifolds scales linearly with Hilbert space 
dimension TV [l3]. In the limiting case where both p(0) 
and Q are pure state projectors, at the extrema only 
has the values zero and unity, corresponding respectively 
to no control or perfect control (i.e., the landscape is 
convex) . 



In the electric dipole approximation, the Hessian of 
the objective function can be written 



H^(<,O--^Tr([[e(T),Mt)],/i(O]p(0)) (13) 
The Hessian quadratic form (HQF), defined as 



-Lu{t')dtdt' (14) 



where uj{t) is an arbitrary real function, is a polyno- 
mial representation of the Hessian that facilitates the 
identification of increasing, null and decreasing direc- 
tions at each critical point. The explicit representation 
of the HQF for the general case of nondegenerate p and 
Q is complicated and is reviewed in Appendix A.l.b. 
Based on this representation, it can be shown that all of 
the suboptimal critical submanifolds corresponding to 
$ values less than the global maximum are saddle re- 
gions, and thus will not act as traps for optimal control 
searches. 

As we will show in Section [Till below, the dimension of 
the global optimum on U{N) is useful for exploring the 
degeneracy of solutions to quantum observable control 
problems. This number ranges from N, for fully nonde- 
generate p(0) and e, to - {2N-2), when p{0) and 6 
are both pure state projectors. In the former case, the 
number of decreasing directions at the global maximum 
is the greatest (iV^ — N) , whereas in the latter case it is 
the smallest {2N — 2). Note that the landscape mapping 
analysis in Appendix lA 1 al indicates that the number 
of positive and negative principal axis directions of the 
Hessian matrix will be preserved upon passage from the 
domain U{N) to the domain e{t), with the remainder 
of the directions on e{t) being fiat. A recent numerical 
analysis [18] confirmed these predictions, by consider- 
ing the problem of optimizing the expectation value of 
a pure state projector over a = 4 quantum system, 
initialized in a pure state, with the goal of |0) — > |3} 
population transfer. In this case, the Hessian can be ex- 
panded on a basis of 2N — 2 linearly independent func- 
tions f3i, as 



n 



k'k 



dr]k' drjk 

T i-T 



dtdt 



,5e{t') (52$! de{t) 



(15) 



(16) 



di^k' 5e{t')5e{t) di^u 



-'0 

2N-2 



1=1 
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where is a vector of appropriate control parameters. 
Diagonalization of the Hessian evaluated at the land- 
scape maximum revealed 10 = 4^ — 2x4 + 2 zero- valued 
eigenvalues, as expected (Fig. Importantly, when 
the dipole coupling strengths were reduced to negligible 
values for all but two of the levels, the number of zero- 
values Hessian eigenvalues dropped to 2 = 2^ — 2x2 + 2, 
revealing the reduction of the 4-level to a quasi 2-level 
system. Thus, the robustness of observable maximiza- 
tion control solutions depends not only on the actual 
Hilbert space dimension, but also on the effective num- 
ber of states that are accessible to the dynamics. 

A related work recently studied the critical topology 
of observable maximization on the domain SU (N) (in- 
stead of U{N)) [19]. It was shown that the set of max- 
ima decomposes into two connected components, and 
an explicit description of both components was derived. 
Separately, Glaser et al. [lO] examined the topology of 
observable maximization for non-Hermitian observables, 
such as those operators that arise in quadrature detec- 
tion. These works, as well as others [1, Q, were con- 
cerned with the problem of identifying optimal controls 
for quantum observables in two steps: first, solving nu- 
merically for the set of unitary matrices U that maximize 
the expectation value Tr{Up{0)U^Q) of the observable 
9, and then, finding a control field e{t) that produces 
the quantum gate U at time t = T . We discuss analyti- 
cal solutions to the latter problem in section HI below. 



plicitly written [21|, |2. 



Se{t) 



.J2Y.{W^U-U^W).,{jHm=0. 



(18) 

The critical topology of the gate fidelity cost function on 
U {N) was first studied by Frankel |23| . Assuming local 
surjectivity of e{t) U{T), a necessary and sufficient 
condition for the critical points is W^U — U'^W or 



{W^Uf = I. 



(19) 



The solutions to this equation are the roots of /, i.e. 
iytc/^diag(Ai,...,A„, A, - (-l)">),'^z = 0,1. These 
solutions fall into equivalence classes indexed by the 
number of eigenvalues Ai = 1. Thus, there are a to- 
tal of iV + 1 critical manifolds, taking on $ values of 
0,4, ...,4iV. The number of suboptimal critical regions 
hence grows only linearly with respect to the system 
Hilbert space dimension N , a slower scaling than that 
of the landscape for observable maximization when both 
p and Q are nondegenerate full rank matrices. 

The Hessian at the critical points is 



H{t,t') = ^TT{w^u{^l{t)^Ji{t') 



p{t')pm (20) 



B. Quantum gate control 

In the electric dipole approximation, the critical point 
condition corresponding to the gradient ([7]) can be ex- 



which can be expanded as 



i i j>i 

X [Rc((*|M(t)b)) xRe((z|Mt')|j))+Im((*|M(t)|j)) xlm((*|/i(t')b-))] (21) 
I 



The number of positive, negative and null directions at tion of the Hessian quadratic form. The expression for 
the critical points can be determined by simple inspec- the HQF is 
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FIG. 3: The dominant eigenvalues of the Hessian matrix for state-to-state population transfer in a simple four level system. 
Only the last 20 eigenvalues are shown, and the remaining ones are essentially zero. For this system with dimension N=4, it 
is evident that the 2N-2 rule is satisfied with six nonzero eigenvalues being present. (From ref p^.) 



Rei{Mt)\j))Lu{t)dt +lm{{i\^iit)\j)u{t)dtY 



(22) 



At the suboptimal critical points, there are N—m even 
and m odd integers rii . It can be shown that the number 
of positive and negative Hessian eigenvalues equals the 
number of odd and even rii, res pec tively, and that the 
remaining eigenvalues are zero |2l| . The numbers of 
positive and negative directions at a critical point m are 
thus 

h+ =m'^;h^ ^ {N -mf, (23) 

whereas all the remaining principal axis directions are 
flat. In particular, all the local suboptima are saddle 
manifolds, and we see again that there are no local traps 
in the quantum control landscape. In contrast to the 
multiplicity of unitary matrices that solve the observable 
maximization problem, the kinematic critical regions of 



the landscape corresponding to global optima are iso- 
lated unitary matrices [2ll | , although an infinite number 
of controls may steer the system to those matrices. 



C. Continuous variable quantum control 

The kinematic landscape critical topology for control- 
ling continuous variable quantum dynamical transfor- 
mations for systems with quadratic Hamiltonians was 
recently studied [23| . These systems are relevant for the 
implementation of continuous variable quantum infor- 
mation processing^^. Continuous variable transforma- 
tions can be realized by harmonic oscillators, molecular 
rotors, or coupled modes of the electromagnetic field. 
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Dynamical transformations for such systems can be rep- 
resented by symplectic propagators fAppendix IA 8|) . 

The critical topology of such landscapes offer insight 
into the differences between control landscapes for dis- 
crete and continuous quantum systems. Since the (quan- 
tum) symplectic gate U is a faithful unitary representa- 
tion of a symplectic matrix S, it is reasonable to define 
the gate fidelity analogously to that for discrete gates as 

J[eit)] = Tt{S - WfiS -W) + is- wfis - w), 

Ss elSp{2N,R), (24) 

where s and w denote phase space displacements. Im- 
portantly, the symmetries of this objective functional 
again permit an analytical characterization of the crit- 
ical topology, although this topology is more complex 
than that of the control landscapes for discrete quan- 
tum systems. If we write the singular value decomposi- 
tion oi W as W = U EV, the critical submanifolds can 
be expressed as [23 |: 

S* = R^DR, R e Stah{E), (25) 

where R is an arbitrary orthogonal symplectic matrix in 
the stabilizer of E in 0Sp(2iV,R): 

Stah{E) = {ReOSp{2N,R)\R^ER = E} (26) 
= OSp{2no) xO{ni) X ■■■0{n,). (27) 

The characteristic matrix D consists of different oper- 
ations on the separate modes represented by diagonal 
blocks of three different types, depending on the singular 
values of the target gate W. In particular, D, and hence 
the critical topology, differs depending on the degener- 
acy of the singular values. Again, all suboptimal criti- 
cal points are found to be saddle manifolds, indicating 
that the control landscape for these infinite-dimensional 
quantum gates is devoid of local traps. 

Although this landscape is devoid of traps, it can be 
shown 26] that the lower symmetry of the continuous 
variable fidelity function, compared to that of the dis- 
crete quantum fidelity function, can result in a more 
rapid scaling of the number of critical manifolds. More- 
over, the critical topology is dependent on the target 
gate (Fig. ID). 

The dynamical transformations of classical systems 
with quadratic Hamiltonians can also be represented by 
symplectic propagators. However, unlike quantum ob- 
servables, classical observables may be expressed as ar- 
bitrary smooth functions on phase space (and hence the 



space of symplectic propagators); thus, unlike quantum 
control landscapes, classical observable control land- 
scapes have no universally characterizable critical topol- 
ogy, either for quadratic or more general classes of 
Hamiltonians. 

For each of the control landscapes discussed above, an 
important issue is the size of the attracting regions of 
these critical manifolds and the behavior of the gradient 
flows of the objective function around them. Unlike the 
critical topology, these gradient flows (which represent a 
geometric property of the landscape) are Hamiltonian- 
dependent, and we will revisit them, including their con- 
nection to topology, in Section VII. 

Although the above analytical results were derived un- 
der the assumption that the fluence penalty coefficient 
A = 0, they remain valid in many cases in the presence 
of a significant cost on the field fluence. In particular, in 
the case of observable maximization where p(0) and Q 
are pure state projectors, it was shown for the model sys- 
tem described in section HA [l^ that the Hessian retains 
2A^ — 2 nonzero eigenvalues in the presence of substan- 
tial fluence costs. In the next section, we discuss how the 
imposition of such constraints facilitates the identifica- 
tion of analytical solutions for certain (low-dimensional) 
observable and gate control problems in quantum me- 
chanics. 



III. ANALYTICAL FEATURES OF QUANTUM 
CONTROL LANDSCAPE GEOMETRY 

A. The role of analysis in exploring control 
landscape geometry 

The previous sections showed that the critical point 
topology of the most common quantum optimal control 
problems can be established analytically, and display 
properties favorable for optimal search. In this section, 
we show that analytical statements can also be made 
regarding the geometry of quantum control landscapes. 
The geometry of a control landscape can be broken down 
into two components: 1) the relationship among controls 
producing the same objective function value (level sets), 
and 2) the search trajectory followed in locating the op- 
timal objective function value. 

The geometry of quantum control landscapes is 
Hamiltonian-dependent. The universal monotonicity of 
quantum control landscapes ensures the convergence of 
local algorithms, but does not provide a direct measure 
of the search effort involved in finding optimal solutions. 
A further reduction in the search effort involved in locat- 
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FIG. 4: The scaling of the numbers of critical submanifolds for discrete quantum (unitary) and continuous quantum (symplec- 
tic) gate control landscapes with system sizei2J]. Degenerate/non-degenerate refer to the singular values of the symplectic 
matrix representing the continuous quantum propagator. Landscapes for the control of discrete quantum propagators all 
have identical critical topologies, whereas those for continuous quantum propagators are target-dependent. See the text for 
definitions of quantum gate terminology. 



ing optimal controls could be aided by analytical land- 
scape geometry. Although these analytical results may 
not fully identify the solution set to an optimal control 
problem, they may nonetheless restrict its structure. 

In the case that no constraints are placed directly on 
the controls or on the time required for reaching the 
objective, an infinite number of solutions exist to quan- 
tum control problems. As such, analytical results per- 
taining to the geometry of the landscape are restricted 
to statements regarding generic features of the controls. 
When constraints or auxiliary costs are imposed in the 
objective function, it is possible in the case of many 
low-dimensional problems to explicitly solve for the op- 
timal controls. In these cases, multiple solutions may 
still exist, but they are distributed among distinct uni- 
tary propagators. 

Studying analytical solutions to quantum control 
problems provides insight into the geometry of con- 
trol landscapes in several ways. First, there can exist 
quantum symmetries that reduce the dimensionality of 
the domain of control fields e{t) over which the control 
search must be carried out. From either a computa- 
tional or experimental perspective, this means that sim- 
pler parametrizations of the control fields can be used in 



optimizations, thereby reducing search effort. 

Second, several important low-dimensional quantum 
optimal control problems are analytically soluble (inte- 
grable) once auxiliary constraints are imposed on the 
objective function. In particular, the problem of realiz- 
ing a quantum unitary transformation in minimal time 
or with minimal fluence can be solved for Hilbert spaces 
of several different dimensions. As shown in Section II, 
a continuous submanifold of unitary matrices is associ- 
ated with the maximization of any observable expecta- 
tion value. The set of points on this submanifold can 
be identified (either analytically or numerically) at min- 
imal cost. Therefore, a submanifold of the set of all 
solutions (one corresponding to each unitary matrix) to 
any observable control problem for such systems can be 
obtained through a combination of analytical and nu- 
merical methods with substantially reduced search ef- 
fort, due to the existence of analytical solutions to gate 
control problems [sl, This submanifold consists of 
all solutions that minimize the auxiliary cost (e.g., field 
fluence). Thus, analytical solutions to gate control prob- 
lems provide a means of further delineating the level set 
geometry of observable control landscapes. 

For these reasons, we review in this section analyti- 
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cal results pertaining to the solution of quantum control 
problems. We discuss 1) analytical results pertaining 
to control mechanisms in arbitrary Hilbert space dimen- 
sion; 2) the integrability of low dimensional problems 
(which in some cases relies on 1), and 3) the reasons that 
integrability breaks down in higher dimensions, whereas 
mechanistic simplicity is retained. 

The basic theorem of optimal control theory used for 
solving problems of this type is the Pontryagin maxi- 
mum principle, reviewed in Appendix I A 21 Consider the 
control problem of minimizing a cost associated with 
steering the system 



X e 



(28) 



from some initial state a;(0) — xq to some final 
state xi. For quantum gate and state control, we 
are dealing with the right-invariant control systems 
U = f{U,e) - -l[Ha + ^Jie{t)]U and t/^ = J{^,e) = 
— jr [Hd + ^J'£{t)\ ip, respectively (see Appendix lA 61 for a 
definition of right-invariance). Note that these equa- 
tions can be generalized to the case of m-independent 
controls, which could take the form of, e.g., components 
of the time-dependent electromagnetic field coupled to 
independent Pauli spin operators in an NMR control 
experiment. When analytically solving for optimal con- 
trols satisfying Pontryagin's maximum principle (PMP), 
the maximization of the function $ in equation ([1]) is 
often imposed as a fixed constraint in addition to the 
Schrodinger equation, and the "cost" to be minimized 
takes the form of the last term in this equation. Such 
problems are framed most conveniently in Hamiltonian 
form. If we denote the cost as f'^{x,s)dt, then the 
PMP-Hamiltonian function is defined as: 



h{x,X,e)^{XJix,e))+Xof{x,e) 



(29) 



where the first term on the RHS is either a matrix or vec- 
tor inner product, depending on whether the problem is 
defined on the space of state vectors or dynamical prop- 
agators, and the A play the role of PMP-conjugate mo- 
menta (Appendix I A 2p . The PMP-Hamiltonian function 
takes on the following form for gate and state control, 
respectively: 



h{M, Xo,u) = Tr [m (u^oitKHd + /ie(t))C/o(t) 



-Ao/"(t) 
(30) 



where M is the conjugate PMP-momentum for gate con- 
trol, P is the conjugate PMP-momentum for state con- 
trol, and where we have considered only the case of pure 
state population transfer in the latter case, for simplic- 
ity. The Pontryagin maximum principle (Appendix I A 2p 
then specifies the PMP-Hamiltonian equations of " mo- 
tion" for the control system; the solutions to these equa- 
tions of motion correspond to the solutions to the control 
problem, i.e., trajectory/control couples {x{t), e{t)). 

The auxiliary cost f'^dt can take on several canon- 
ical forms. The most common are (assuming m inde- 
pendent controls): 1) The field fiuence for fixed transfer 
time T, E ^ X)™ i and 2) The total transfer 

time, with fluences either unconstrained or subject to 
the constraint /J" J2iLi ^1 — C", with C an arbitrary 
positive constant, on the field amplitudes. Note that in 
the case of 2), the final time in <i>(T) can be taken to be 
a variable rather than a fixed parameter. An important 
distinguishing feature between solutions corresponding 
to these different auxiliary costs is the time-dependent 
structure of the corresponding optimal control fields. 
When controls are bounded, the optimal fields are typi- 
cally resonant with the system transition frequencies, as 
discussed further below. By contrast, when controls are 
unbounded, the optimal fields are often singular (i.e., 
short sequences of hard pulses) Q . 

Since landscape geometry is Hamiltonian-dependent, 
it is important to specify the class of Hamiltonians when 
studying analytical solutions. We restrict the analysis 
primarily to state and gate control problems defined on 
the special unitary group SU{N). Consider the follow- 
ing right-invariant control system on U (N) with m con- 
trols: 



U{t) 



U{t) 



(32) 



h{P, Ao,u) = (P, {Hd + ^e(t))^(t)) + Ao/°(i) (31) 



The matrices iJ^, fJ-i,i — 1, ■■■,m are skew-Hermitian ma- 
trices. If we write Hd — Dh^ + Hd and Jii — D^^ + 
IJLk.i = l,...,m, with = <^^a.g{\TY{Hd),\TY{Hd)), 

D^. — diag^Tr(/ifc)) ^Tr(/ii)), i = l,...,m, the matrices 
Dfj^ , D^. give a pure phase contribution to the solution. 
These terms do not contribute to the relative phases of 
the components of the state vector and therefore can 
be neglected since states that differ only by a phase 
are physically indistinguishable. Thus, we consider the 
physically equivalent problem on the domain of traceless 
skew-Hermitian matrices, the Lie group SU{N). 

Just as analytical solutions to the Schrodinger equa- 
tion exist only for the simplest quantum systems, for- 
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mal analytical solutions to the PMP for quantum con- 
trol problems involving arbitrary Hamiltonians are very 
scarce. However, for certain classes of Hamiltonians, 
or under certain physically reasonable approximations, 
control problems of real practical interest may be inte- 
grable. In what follows, we assume that the rotating 
wave approximation (RWA), reviewed in Appendix lA 3i 
holds for the dynamics under consideration. It is im- 
portant to note that this latter condition is often not 
satisfied, necessitating the use of numerical methods to 
solve the most general class of control problems (Section 
IIVI) . However, in several of the most commonly encoun- 
tered quantum control problems, the RWA does hold to 
a reasonable approximation. 

The methods of geometric control theory and sub- 
Riemannian geometry [27| provide a means of obtain- 
ing, in certain specific cases, analytical solutions for the 
optimal control fields reaching a given objective. Al- 
though geometric control theory was originally devel- 
oped in the context of classical control, it has recently 
been shown that the Pontryagin maximum principle in 
a geometric framework can be used to obtain analyt- 
ical solutions for optimal control fields for such low- 
dimensional quantum control problems. We examine 
these specific solutions after briefly reviewing analytical 
results pertaining to the control mechanisms for fluence- 
minimizing state controls. 

B. Analytical solutions to state control problems 

For discrete quantum control problems, the existence 
of symmetries on the Hilbert space of states often al- 
lows a significant reduction in the dimensionality of 
the problem and the parameterization of the controls. 
This feature extends beyond the limited subset of low- 
dimensional problems with analytical solution to dis- 
crete quantum control problems in arbitrarily high di- 
mensions. Let V{t) = X^fc^i denote the total time 
dependent control Hamiltonian. A problem of particular 
interest for chemical applications is where control laser 
fields couple only neighboring energy levels of the sys- 
tem, i.e., Vj^k = Vkj — if j ^ k ±1. This is a common 
scenario in strong field control experiments. The optimal 
controls for these problems are often in resonance with 
the transition frequencies of the uncontrolled system. It 
can be shown that for auxiliary cost 1 above (i.e., flu- 
ence minimization) with Hamiltonians of this form, the 
controls will always satisfy a more general condition of 
"weak" resonance. In either case, the search space of the 
problem is then reduced from the Hilbert sphere S'^^~^ 



to S^. 

Definition 1 (Resonance, weak resonance of optimal 
controls) A control Vj^kit) is said to be resonant with 
respect to the uncontrolled system with state function ip 
if it has the following form: 

Vj,k{t) = A,,k{t) exp {i [{Ej - Ek)t + V2 + (jjj.k]) (33) 

where A^^ki-) ■ [0,T] R, Aj^k = -Ak^j, (jij^ = 
arg{ipj(Q)) — arg{ipk{0)) G [— tt, tt] . Physically, this 
means that the lasers oscillate with frequency {Ej — 
Ek) /27r; Aj^k describes the field amplitudes. A control 
Vj,k is weakly-resonant if it is resonant in each interval 
of time in which the states that it is coupling (i.e., ipj 
and ipk ) are different from zero. fj^/ . 

Let us denote these latter intervals Ij^k,i, where j, k in- 
dexes the matrix elements of the Hamiltonian and I in- 
dexes the time interval where ijjj, ipk 7^ 0. Then accord- 
ing to the terminology above, Vj,k is weakly resonant 
if 

H],k(t) \ij,k,i = Aj^k,i{t)e^pi(j>j^k,i 

Aj^kdi ) ■ Ij,kd IR, ^j,k,i = —Ak,j,i. (34) 

The phenomenon of resonance may be viewed ge- 
ometrically as originating from a rotational symme- 
try in Hilbert space, under the transformation Rota '. 
{tpi, ...j-ipn) (e'^^'Ai, e'""'0n)- The two admissible 
curves ^(.) = (^i(.), ?/'«(.)) and Rota{'^{.)) on [0,T] 
have the same cost. In particular, any point within 
the set T^2 generated by the action of any element of 
Rota{ip{.)) on the state vector -0^ can be reached at the 
same cost from any point within the set T^i , defined 
analogously. Let us represent the controls as 

Vlkit) ^ V,,k{t) N KfcW exp(z/3[,(t)), 

(35) 

decomposing them into non-resonant and resonant time- 
dependent parts. If V'(-) : [0,T] S*^""^ is a min- 
imizing trajectory between sets M^i,M^2, then the 
transversality condition of the maximum principle (Ap- 
pendix |X2| implies that {P{t),TM^^^t)) = 0. We write 

= Ek ^here F{^) and 

G{i/j) are vector fields subsuming the action of the reso- 
nant contribution to the (real, imaginary) control Hamil- 
tonians on the state vector ijj. It can then be shown 
[29| that G^- 1. is always tangent to a submanifold of 
S'^"~^ whose points are reached with the same cost, i.e. 
G^.,(V^(0) GTM^(t), Vi. 
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Therefore, in the maximum principle, 
{P(t),G^j^f.{'tp{t))) = 0, and the maximahty condi- 
tion of the maximum principle implies that Wj,fe(i) = 0. 
It follows that it is possible to join any two eigenstates 
V'j, V'fc by a trajectory that is in resonance. For states 
that are not eigenstates, the weak resonance condition 
holds. 

State control and gate control for discrete quantum 
systems can both be framed in terms of the identifica- 
tion of geodesic trajectories under suitable metrics. The 
existence of a set of symmetries is important for the 
identification of analytical solutions to these problems. 
In particular, for state control problems, the reduction 
in control dimensionality following from resonance is es- 
sential for obtaining analytical solutions in low Hilbert 
space dimensions. 

Analytical solutions to problems of the general class 
described above can be obtained for population transfer 
in two- and three-level quantum systems, for off-diagonal 
control Hamiltonians whose Lie algebra spans the entire 
dynamical group. For instance, for population transfer 
in three-level systems using fluence as the cost with two 
controls, the PMP-Hamiltonian (13111 becomes 



h{P, Ao, u) = (P, {Hd + fiiEiit) + fi2e2{t))ib{t)) + 

ho{slit)+elit)). (36) 



Since our primary focus here is the relationship be- 
tween multiple quantum control solutions, we relegate 
a summary of this problem to Appendix lA 41 For our 
present purpose, its most important features are that 
the assumption of resonant controls permits the (sub- 
Riemannian) problem to be mapped from to S^, and 
that the resulting reduced Hamiltonian system is inte- 
grable. In four dimensions, the corresponding state con- 
trol problem resides on S'''. It appears that the Hamil- 
tonian system given by the maximum principle is not 
integrable in this case, but the resonance condition still 
holds, and simplifies numerical search in this and higher 
dimensions. 

Although the the class of systems described above - 
where controls couple only two neighboring levels - is 
practically important, for more general systems the op- 
timal controls may not be resonant or weakly resonant. 
Control mechanisms for such systems have been studied 
using numerical methods described in Section ITVl 



C. Analytical solutions to gate control problems 

As discussed above, quantum gate control solutions 
can be used to significantly reduce the search effort re- 
quired to obtain solutions to the corresponding observ- 
able control problems. Analytical solutions have been 
found for gate control problems in dimensions 2,4 and 
8 for important classes of Hamiltonians, under the as- 
sumption of unbounded controls ^ HI . These problems 
can be framed as so-called adjoint control problems, a 
type of sub-Riemannian control problem where the opti- 
mal control minimizes length on a geometric space under 
constraints on the possible paths. An essential prerequi- 
site for their analytical solution is that the Riemannian 
space display certain symmetries, which in this case are 
endowed by the geometry of the special unitary group. 

Instead of seeking fluence minimizing controls (cost 1) 
we consider here the minimization of the transfer time as 
the auxiliary cost (cost 2 above), with unbounded con- 
trols. This problem is particularly important for min- 
imizing the time required for coherence transfer in nu- 
clear magnetic resonance (NMR) experiments with ra- 
diofrequency pulses; the resultant time optimal pulses 
outperform those typically used in NMR by a signifi- 
cant margin [1, Q . In the previous section we focused 
attention on systems whose control Hamiltonians span 
the entire dynamical group. Here, we examine the more 
common case where the control Hamiltonians span only 
a subgroup of the dynamical group; if controls are un- 
bounded, the latter assumption is required for a lower 
bound on the evolution time to exist, since unbounded 
controls can attain the target in arbitrarily small time. 
The PMP-Hamiltonian is then 

h{M,Xo,u) = Tr [m (u^oit){Hd + fieit))Uoit))] + ^Xo- 

(37) 

Note (Appendix A2) that the maximum principle for 
time optimal control differs slightly from that for the 
problem of minimal field fluence with fixed final time. 
In fact, for time-optimal control problems where the 
controls do not span the dynamical group, framing the 
problem in terms of an adjoint control system (and an 
associated "adjoint maximum principle") facilitates so- 
lution, as shown below. 

To understand this approach, let G denote the spe- 
cial unitary group SU{N). Under the assumption of full 
controllability of the system, the algebra s generated by 
the entire control system {Hd, /ii, /im} is equal to the 
Lie subalgebra su{N), and the corresponding group S is 
equal to G. We call the subalgebra generated by the con- 
trols {/ii, I, and the corresponding subgroup K. 
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Since the controls are unbounded, any element of K can 
be reached in arbitrarily small time. Consider the prob- 
lem of driving the evolution from Ui to U2 in the shortest 
possible time, and let the coset KUi = {kUi\k G K}. We 
then need to find the fastest way to move from KUi to 
KU2, since the time required to travel anywhere within 
a coset is negligible. 

If we decompose G = p ® I such that p is orthogonal 
to I, then p represents all possible directions to move 
in G/K. All directions in this set can be generated by 
using the control Hamiltonians to place the system at 
appropriate starting points k € K , from which the drift 
Hamiltonian moves the system in the directions given by 
klHdki. However, we cannot access all these possible di- 
rections directly. All motion in G/K is generated by the 
drift Hamiltonian Hd- These directions are represented 

by 

AdKiHd) = {AdkAHd) = klHdki\ki eKjep, (38) 

called the adjoint orbit of Hd under the action of the 
subgroup K. This form of direction control has been 
defined as an adjoint control system, reviewed in Ap- 
pendix [X2] 

The goal is to find the shortest path between two 
points in G/K under the constraint that the tangent di- 
rection must always be in the adjoint orbit (Fig. ??).The 
shortest paths between points on a manifold subject to 
the constraint that the tangent to the path always be- 
longs to a subset of all permissible directions are called 
sub-Riemannian geodesies. The problem of finding 
time optimal control laws then reduces to finding sub- 
Riemannian geodesies in the space G/K, where the set 
of accessible directions is the set AdK{~iHd). This prob- 
lem can be framed in terms of an adjoint cost function, 
/(P) = Tr(AtHP), with PA^ S p. The adjoint-PMP 
Hamiltonian is h{P{t), X{t),n{t)) = Tr(At(t)H(i)P(t)). 
Solutions to the control problem follow from the adjoint 
maximum principle (Appendix A2). 

For one and two spin systems, G/K is a Riemannian 
symmetric space. In this case, the decomposition 

g=p(^l p^l^ (39) 

satisfies the commutation relations [1,1] C I, [p, I] = 
p, [p,p\ C I. This property implies that the tangent 
vectors to the path through G/K must commute, since if 
they do not, a component of the path must lie within K, 
and hence the path cannot be time optimal. Let h C p 
denote a subspace of maximally commuting directions or 
generators in G/K space. Any unitary propagator Up 



can then be written Up ^ fc2cxp(y)fci, where Y ^ h. 
According to the time-optimal torus theorem, the fastest 
way to reach Up is on the shortest path between the 
identity and the propagator exp(y) such that all tangent 
directions commute. If we express Y as 

p 

Y = Y,a^AdkAHd), az>0, (40) 

i=l 

it can be shown that the shortest path corresponds to 
the choice of Ui with the smallest value of X^f^iO^j- 
For two-dimensional systems, G/K is of rank 1, so 
Y — aAdk{Hd), a > for some k ^ K, and the time 
optimal path to coset exp(F) is to flow along Adk{Hd) 
for time a. Qualitatively, the optimal controls are pulse- 
drift-pulse sequences, i.e. hard pulses followed by evolu- 
tion under drift and then some hard pulses again. For 
four-dimensional systems, it is necessary to pulse the 
controls intermittently to generate new ks, to create a 
chained pulse-drift-pulse sequence. 

Appendix lA 41 reviews the explicit construction of the 
geodesic trajectories and associated minimal times for 
the problems in dimensions 4 and 8, based on Pontrya- 
gin's maximum principle and the time-optimal torus the- 
orem. By first numerically determining the set of unitary 
propagators mapping to a particular observable expec- 
tation value, and then applying these analytical results 
to identify the optimal field producing that propagator 
in minimal time, we can obtain analytical insight into 
the relationship among time-minimizing controls on any 
given level set of a quantum observable control land- 
scape. 

In higher dimensions, G/K is no longer a Riemannian 
symmetric space, and it is necessary to move back and 
forth in noncommuting directions to obtain the optimal 
path through G/K. In these cases, the approach of rep- 
resenting the invariant control system on a Lie group 
as an adjoint control system is still applicable, but ana- 
lytic solutions have not yet been found. Nonetheless, the 
application of sub-Riemannian geometry to problems of 
quantum gate control is currently a topic of intense in- 
terest, and promises to afford additional analytical in- 
sights into the geometry of quantum control landscape 
level sets. 

Further analytical studies on the control of unitary 
transformations (in two-level quantum systems) were 
carried out by D'Alessandro and Dahleh [30|]. These 
authors studied the related problem of fluence minimiz- 
ing controls driving a two-level quantum system to a 
target unitary propagator at fixed final time T. In two 
dimensions, this problem also has analytical solutions, 
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for both single and multi-input control systems. The re- 
sulting optimal controls have a more complicated tem- 
poral structure; it was shown that the optimal fields are 
always Jacobi elliptic functions [s^. Thus, the fluence 
minimizing solution does not have the simple singular 
behavior of the unbounded time-minimizing solutions, 
consistent with the phenomenon of resonance discussed 
in the previous section. 



IV. NUMERICAL EXPLORATION OF 
QUANTUM CONTROL LANDSCAPE LEVEL 
SETS 

A. Algorithms for level set exploration 

We have seen that for certain classes of low- 
dimensional quantum optimal control problems, analyt- 
ical solutions for the control fields exist. However, as 
the system dimension increases, analytical solutions be- 
come increasingly difficult to obtain. Moreover, we have 
seen that the optimal controls for these problems dis- 
play particularly simple mechanistic properties, such as 
resonance with the transition frequencies of the system. 

For the problems studied above, auxiliary costs were 
imposed on the controls, such as minimal time or mini- 
mal fiuence. In the absence of these constraints, quan- 
tum optimal control problems generally possess an infi- 
nite number of solutions [J . A quantum control level set 
(Fig. 2) consists of the collection of all fields that pro- 
duce a particular value for the target observable, regard- 
less of the intervening temporal dynamics (i.e., control 
mechanism). A natural question concerns the relation- 
ship between these degenerate solutions, and whether 
their associated control mechanisms retain the simplic- 
ity of those for low-dimensional systems. From a practi- 
cal standpoint, a high degeneracy of solutions will enable 
control fields to be tailored for specialized applications in 
quantum technology, through the imposition of auxiliary 
costs. Level set degeneracies also improve the robustness 
of control solutions. There will inevitably be physical 
inaccuracies in the experimental implementation (owing 
to the presence of noise, decoherence) of a particular 
solution, and one would like the nonideal fields to also 
produce dynamics that reach the objective. 

Conventional algorithms for optimal control, being de- 
signed for identification of the optima of the objective 
function, are not well-suited to exploring the level sets of 
quantum control landscapes. For this purpose, Rothman 
et al. [31I, m, [3^ developed a diffeomorphic homotopy 
procedure for systematically exploring diverse control 



fields on a landscape level set, referred to as diffeomor- 
phic modulation under observable-response-preserving 
homotopy (D-MORPH), which we summarize here. The 
procedure can selectively explore the control fields on a 
level set that display desired properties. For example, 
the algorithm allows one to numerically explore the con- 
trol fields producing the various unitary propagators on 
a level set with minimal fiuence or in minimal time, for 
control systems that are analytically intractable. 

It is convenient to parametrize the field and its varia- 
tion by the exploration variable s: 



e(t) =^ e{s,t) 



de{t) de{s,t) 



(41) 



(42) 



where < s < 1. Since the goal is to explore the set of 
control fields that are compatible with a given observ- 
able expectation value, the solutions e(s, t) satisfy the 
nonlinear equation 



F{s) = {Q{s))t-Ct (43) 
= (e([£(s, t),Hdis), ^l{s)] , T)) ~Ct^ 0,(44) 

as a function of s, where Ct is the desired observable 
expectation value. 

The maintenance of in (6) over an infinitesimal step 
ds through the level set can be written 



ds 



(6) 



5{Q) de[s,t) 
5e[s,t) ds 



di = 



(45) 



The neglected higher-order terms only become relevant 
near an extremum, where = 0. The relationship in 
equation (|45p is highly underspecified for determining 
e(s,t) as s traverses a level set. As shown in Appendix 
lA 5i the integral equation may be expressed as an equiv- 
alent initial value problem 



= S{t){f{s, t) - ^«o(5, t, T)}, s > (46) 



where 



aa{s,t,T) 



s{e) 



(5e(s, t) 

^(V-ol [u^iT,o)eu{T,o),u^it,o)^lU{t,o)] |^Ao), 

(47) 



1 
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FIG. 5: Time optimal path (dashed arrows) between elements Ui and U2 belonging to G. The long arrows depict the fast 
portion of the path involving movement within coset KU and correspond to the pulse; the short arrow depicts the slow portion 
of the path connecting different cosets and corresponds to evolution of the couplings. 



Here S{t) is an arbitrary weight function (e.g., it 
can bias the control field towards a short pulse that 
approaches zero at the endpoints of the time inter- 
val), 7(s) = S{t)f{s,t)aa{s,t,T)dt and r(s) = 

S{t) [ao(s, i, T)]^ di. The ability to freely choose the 
function f{s,t) permits exploration of the multiplicity 
of solutions to the original integral equation. Regardless 
of the choice of /(s, t), (6(s)) will remain invariant over 
the s > trajectory. 



B. Quantum control mechanisms and robustness 

Perhaps the most compelling reason to explore quan- 
tum control level sets is the insight they offer into con- 
trol mechanisms. The ability to transform one successful 
control into another, and therefore one control mecha- 
nism into another, must be considered when seeking to 
establish the mechanism of any particular quantum con- 
trol problem. Indeed, before making any definitive state- 
ments about mechanisms, it is necessary to understand 
the diversity of controls on a level set. How diverse can 
the solutions be, given the relatively simple structure of 
the optimal controls for integrable problems? 

In order to investigate this question, Rothman et al. 
[33} applied the D-MORPH technique to an eight-level 



Hamiltonian with nondegenerate energy levels and with 
couplings only between adjacent, next-nearest and next- 
next nearest states. The control objective was state- 
state population transfer |1) — > |8); level sets of both 
high and low yield were explored (Fig. [HI) In the case of 
a choice of /(s, t) corresponding to fluence minimization, 
the control field asymptotes as s ^ 00 towards a field 
of minimal fluence, although a different asymptotic field 
is produced for each initial field e{0,t). By contrast, 
for a fluence maximizing function /(s,i), the distance 
between e{0,t) and s{s,t) increases without bound. In 
the latter case, the use of multiple transition pathways 
over the s interval suggests that the level sets are rich 
with fields producing vastly different dynamics. The ob- 
servation that controls of minimal fiuence often involve 
simpler mechanisms is consistent with the mechanisms 
apparent in the fiuence and time-minimizing analytical 
control solutions discussed in the previous section. In 
order to assess the robustness of control fields to noise 
along the level set, the Hessian was evaluated at 
various points along the trajectory. In the case of flu- 
ence maximization, the trace of the Hessian was not 
preserved, indicating varying degrees of robustness of 
(0(T)) to noise in the control field e{s, t). 

In the weak-field regime, optimal fields for control 
of discrete quantum systems are typically in resonance 
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FIG. 6: Starting from an initial control field e{s = 0,t), the control fields e±{s,t) are evolved on the interval s € [0, f] subject 
to the functions f±, where ± refer to fluence maximization and minimization, respectively, a) Under fluence maximization 
the control field grows in amplitude and incorporates complex structure; under fluence minimization the progression of fields 
decreases in amplitude, b) Cross sections of the fields in a) are plotted. The field at s = is the same for both e±{s,t), but 
different free functions f{s,t) cause the fields to evolve in dramatically different ways with s. (From ref d^l-) 



with the transition frequencies of the system. By con- 
trast, for continuous quantum systems, the fields are 
usuaUy not simply related to natural resonant frequen- 
cies. Wu, Chakrabarti and Rabitz compared the mecha- 
nisms of optimal control for discrete and continuous vari- 
able quantum gates [13 ■ Figure [7] depicts the optimal 
control fields for achievement of the SUM logic gate (a 
4-dimensional symplectic matrix) for a model two-mode 
continuous variable system. The resulting optimal con- 
trol fields typically display complicated Fourier spectra 
that suggest a richer variety of possible control mecha- 
nisms. The larger diversity of mechanisms at work in 
continuous variable quantum control may have implica- 
tions for the comparative effort of locating continuous 
variable versus discrete quantum control, since in the 
latter case the dimension of the search space cannot be 
reduced by requiring that the optimal controls adopt a 
canonical shape. 



C. Hamiltonian-dependence of landscape level set 
geometry 

An important quantum control goal is to discern the 
distinct controls that can achieve the same objective in 
each member of a set of similar quantum systems. A 
common outcome might be, for example, breaking the 
same type of bond in a set of molecules or creating an 
analogous excited state in a family of related systems. 
The notion of families of reactants in chemistry can be 
given a rigorous meaning in terms of the similarity of op- 
timal control fields driving systems with related internal 
Hamiltonians to the same final state. 

The diffeomorphic homotopy approach described 
above for level set exploration can be extended to study 
the relationship among controls producing the same ex- 
pectation value for homologous quantum systems [3l| . 
Diffeomorphic changes in the system Hamiltonian are 
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Time Frequency 



FIG. 7: The optimal control fields and corresponding Fourier power spectra for continuous quantum SUM gate control in a 
controllable system, using two distinct control Hamiltonians. The solid and dashed lines depict the associated control fields 
in arbitrary units. Compare to the characteristic beat field structure in Fig. |6] representative of optimal controls for discrete 
quantum systems. (From ref [13].) 



introduced by scanning over a homotopy parameter s 
and then monitoring the control field response needed 
to maintain the value of a specified target observable. 
The time-dependent Hamiltonian is written as a func- 
tion of the homotopy parameter s as 

H{s,t) ^ Hdi-s) ^ fi{s)e{s,t). (48) 



Figure [8] schematically displays the concept of a trajec- 
tory through Hamiltonian space. 

It is possible to derive a differential equation for ^"^g^'*^ 
for remaining on the level set under s-dependent changes 
in the system Hamiltonian. The following two terms 



ai{s,t,T) = -i-(^o|[[/t(T,0)e[/(T,0),C/t(t,0)-^[/(t,0)]|^o) (49) 

a2{s,t,T) = -^{iJo\[U\T,0)QU{T,0),UHt,0)^^^U{t,0)]\^o) (50) 

I 



analogous to oq above account for changes in the inter- 
nal Hamiltonian and dipole operator, respectively, along 
the trajectory. As summarized in Appendix I A 5[ we ob- 
tain the explicit initial value problem: 



de{s,t) _ ^ {b{s,T) - j{s)) ao{s,t,T) 

ds -J^""'^)^ T{s) ' - 

(51) 

Rothman et al. carried out numerical D-MORPH sim- 
ulations across a family of related three-level model sys- 
tems forming a homologous set. In these studies, trans- 
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fer of pure state population was considered, although the 
D-MORPH methodology is applicable to arbitrary ob- 
servable maximization problems originating from arbi- 
trary mixed states. The dipole moment operator and in- 
ternal Hamiltonian were varied both independently and 
in unison. 

In the case of independent dipole diffeomorphism, the 
goal was to move the population from state |1) to state 
1 3). The direct transition was initially allowed, by set- 
ting /Ui3(0) 7^ 0, but finally forbidden, /ii3(l) — 0, while 
along the alternative dynamical route the opposite sit- 
uation exists, i.e. /Xi2(0) = /i23(0) = and /^i2(l) 
and ^23(1) 7^ 0. Therefore, the population transfer oc- 
curs by two different mechanisms at s = 0.0 and s = 1.0. 
Two different trajectories were followed through Hamil- 
tonian space, one along a straight path between the two 
dipole operators, and one along a curved path. Figure [5] 
depicts the variations in the control field required to pre- 
serve the observable across these homologous quantum 
systems. 

It is possible to redefine the problem of level set ex- 
ploration for families of related quantum systems, by 
identifying the set of dynamically homologous quantum 
systems that produce the same expectation value of a 
quantum observable when subjected to a fixed time- 
dependent control field [3j|. Rather than tracking over 
an arbitrary path in Hamiltonian space and determin- 
ing the change in the field that preserves the observable 
expectation value, in this case the path in Hamiltonian 
space is determined by the constraint that the control 
field does not change. An infinite number of such paths 
are possible, just as in the former problem. Topolog- 
ically connected and disconnected families of homolo- 
gous Hamiltonians have been shown to exist under var- 
ious conditions. Numerical calculation of the Hessian of 
the associated cost functional indicates that the critical 
topology of this landscapes displays remarkably similar 
features to that for observable expectation value con- 
trol; in particular, the critical points appear to be sad- 
dles rather than local traps, and the rank of the Hessian 
at the critical points displays the same behavior with 
respect to the degeneracies in the matrices p, 6. 



V. EXPERIMENTAL EXPLORATION OF 
QUANTUM CONTROL LANDSCAPES 

A. Level sets 

Experimental methods are currently being developed 
for exploring control landscape level sets. Because the 



domain of control fields is infinite dimensional, the ex- 
perimental investigation of quantum control landscapes 
requires careful choice of parametrization of the field 
such that the landscape can be sampled sufficiently. 

Roslund and Rabitz ^3B\ explored the level set surfaces 
for second harmonic generation and related nonresonant 
two-photon absorption. The second harmonic spectral 
field is given by 



Ei{n')Ei{n2 - ^')dn' (52) 



where £2(^12) and Ei{U) are the complex spectral en- 
velopes of the second harmonic and control pulses, re- 
spectively, and the frequencies of these envelopes are 
relative to their spectral center, i.e. Q = lo — loq and 
fl2 — Lo — 2luq. The time integrated signal, given by 



Soc \Ei{t)\'^dt. 



|£;2(f^2)|'dr!2 (53) 



is measured. The spectral phase (t>{^) serving as the con- 
trol is a truncated Taylor expansion around the center 
frequency wq. 
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(54) 



where the zeroth and first-order terms are discarded be- 
cause they simply correspond to an arbitrary constant 
phase and shift in the time origin of the pulse, respec- 
tively. The level sets were expressed on the domain of 
phase parameters a, b, c; multiple level sets were iden- 
tified, with one surface at 50% yield shown in Fig. [51 
The level sets of different yield were nested in the phase 
parameter space (Fig. [T0|) . Each of the continuously 
varying control fields over a given level set preserves the 
observable value by its own distinct manipulation of con- 
structive and destructive quantum interferences. Thus, 
the richness of quantum control fields meeting a par- 
ticular observable value is accompanied by an equally 
diverse family of control mechanisms. 

For these systems, the level sets were shown to be 
closed surfaces in the control parameter space. In or- 
der to explore the origin of phenomenon, the Hessian 
of the cost functional was computed numerically at sev- 
eral points progressively farther away from the global 
optimum. Based on the positive-definitcness of the Hes- 
sian, it was shown that the level sets arc predicted to 
be ellipsoids (see below) , consistent with the experimen- 
tal observation. In general, however, level sets can be 
unbounded in extent. 
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FIG. 8: (a) Starting from quantum system A with Hamiltonian Ha, three paths are shown passing through systems B and C 
with their associated Hamiltonians Hb and He- Three particular control fields ei[s,t),i = 1,2,3 characterize the pathways 
along which the common observable (0(r)) is preserved; these distinct observable-preserving controls are specified by the 
auxiliary functions fi{s,t),i — 1,2,3. (b) Control fields as functions of s and t for the combined internal Hamiltonian/dipole 
diffeomorphism example discussed in the text (with fluence minimization). Target observable population in state | 3) is 
preserved at t = T for all s. (From ref HJ].) 




FIG. 9: Experimental second harmonic generation (SHG) level set surface for a yield of 50%. Included are three experimentally 
retrieved control fields located on the surface. (From ref [35|.) 
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B. Landscape topology 

In section II, we demonstrated that formally, no traps 
exist in quantum control landscapes in the absence of 
direct costs or constraints placed on the control field ^ . 
Roslund and Rabitz [sl] made the first explicit exper- 
imental demonstration of the trap-free, monotonic be- 
havior of unconstrained quantum control landscapes in 
the case of two systems, unfiltered and filtered second 
harmonic generation (SHG). These landscapes were ran- 
domly sampled and interpolated up to landscape level of 
data noise. In order to explore the topology of the land- 
scapes, 1500 trajectories originating at random points 
were propagated along the gradient flow of the objective 
functional, according to the equation 

r(s) = r(0) + / \lSt [r(s')] ds' (55) 
Jo 

where the gradient in the integrand was determined from 
the laboratory SHG landscape data. 3% (48) of these 
trajectories did not converge to the global optimum, and 
ended up distributed among two other local maxima, but 
these latter maxima were demonstrated to be artifacts 
due to noise in the control apparatus. 

Figure [TT] depicts several possible search trajectories 
along the filtered SHG landscape. (Filtering the SHG 
signal to be evaluated at ^i = 2wo removes the depen- 
dence of the signal on the cubic Taylor coefficient in the 
polynomial basis.) Several of these paths correspond to 
simple parameterizations of the control field. As can 
be seen, restricted parameterization of the control field 
will generally produce artificial structure by forcing pro- 
jections of the original full infinite dimensional control 
space. 

Although linear trajectories in the polynomial phase 
representation considered above are incapable of follow- 
ing the gradient flow trajectory, they do display the 
favorable property of preserving the intrinsic topology 
of the landscape. This can be verified by perturbation 
analysis near the global maximum of the filtered SHG 
landscape. Expanding the exponential phase to second 
order around the optimal solution 0(w) = 0, it may 
be shown [3(| that the perturbative signal 55*/ (O) = 
S*j — Sf{^l), where S'y is the transform limited sig- 
nal, indicates that the level sets are ellipsoidal. In 



Again, this statement holds rigorously in the absence of abnor- 
mal extremal controls. See section VII for a detailed discussion. 



addition, assuming a spectral amplitude of the form 
A{n) = exp(-=^), the normalized signal variation un- 
der a Taylor expansion of the phase functional preserves 
this landscape topology. In general, however, the appro- 
priate choice of control parameters or variables that pre- 
serve landscape topology may not be apparent a priori. 
Methodologies exist [33| for transforming to an optimal 
local basis set of laboratory control parameters. A phys- 
ically convenient parameterization is first chosen prior 
to the outset of the experiment, followed by a Hessian 
analysis to determine a locally separable representation. 
This methodology has been successfully illustrated using 
the example of molecular fragmentation of CH2BrI. 

A possible cause for the appearance of local traps in 
quantum control landscapes is the existence of costs or 
constraints on the controls, which in some cases may be 
impossible to avoid. Numerical results [3] indicate that 
landscape topology should be reasonably preserved even 
in the presence of small penalties on the field fluence. 
These results suggest that in weak-field experiments, 
where the control field constraints may not be partic- 
ularly limiting, the topology of experimental quantum 
control landscapes should remain monotonic. 

In the strong field regime, however, local traps may 
appear more readily. For example. Wells et al. [3^ 
applied adaptive search algorithms to the fragmenta- 
tion of a complex molecule, octahedral sulfur (5*8), in- 
vestigating several different control field parametriza- 
tions. The structure of the optimal pulses obtained us- 
ing these various parameterizations were considerably 
different, although they produced comparable signal en- 
hancements. The fluence of the control fields were con- 
strained considerably, corresponding to large values of 
A in equation ([T]). Although the sampling was not ex- 
haustive enough to rigorously establish level set struc- 
ture or landscape topology, the results suggested that 
local maxima existed in the S'g fragmentation landscape 
for the parameterizations employed. However, even in 
the strong field regime, the fundamental monotonicity of 
the landscape need not be compromised. In related work 
[391] , the control landscape for the strong- field ionization 
of potassium atoms was sampled by phase modulated 
pulses. The intensity of the Autler-Townes components 
in the photoelectron spectra were controlled by a sinu- 
soidal phase modulation function. The use of a two- 
dimensional parameter space enabled constrained, but 
effective sampling of the control landscape. The maxima 
and minima of the landscape were identified, with clear 
level sets, and no evidence for local traps was found. 

In most cases of practical interest in the weak-field 
regime, unconstrained quantum control landscapes pos- 
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FIG. 10: Experimental second harmonic generation (SHG) level set surfaces with increasing magnification moving to the right 
for a = 0.10 (light blue), 0.25 (red), 0.50 (dark blue), 0.75 (green) and 0.90 (gold). Each surface is sliced along its a-c plane 
at fe = so that the interior is visible. (From ref [35|.) 



sess no suboptimal traps. Thus, local experimental 
search algorithms should be effective in locating opti- 
mal controls; moreover, since gradient-based algorithms 
can take advantage of landscape structure, they may 
perform better than "blind" algorithms (e.g. genetic 
algorithms) under suitable conditions. In the aforemen- 
tioned work of Roslund and Rabitz, only the total SHG 
yield was measured; the gradient of the objective was 
determined based on radial basis function interpolation. 
More recent work [40l| has addressed the question of how 
to experimentally measure and follow the gradient flow 
of the observable maximization objective function, given 
that the basis must change at each step along the curvi- 
linear path. The gradient of the filtered SHG objective 
was measured using a moment-based method with only 
30 observable measurements on a 128-dimensional pa- 
rameter space. Despite the statistical uncertainty in the 
measurements and the presence of noise, following this 
flow resulted in convergence to > 90% achievement in 
half the number of steps that were required for a GA. 
Note that accurate estimation of the gradients of ob- 
servable expectation values with respect to control field 
parameters is properly a subject of quantum statistical 
inference [4l|. Quantitative assessment of the statisti- 
cal uncertainties associated with these estimates, as a 
function of the number of measurements made, is essen- 



tial for determining the speedup that can be achieved 
by using gradient versus adaptive search algorithms. 

Following the gradient flow of the objective function 
exploits the favorable topology of quantum control land- 
scapes, but does not explicitly exploit their geometry. 
In particular, the best path to the global maximum in 
Fig. [TT] is not necessarily the gradient flow path. A 
further possibility is to use local algorithms that make 
use of local gradient information, but do not follow the 
gradient flow directly, instead tracking alternative ob- 
servable expectation value paths. In this regard, an im- 
portant question is whether certain observable paths are 
expected to display more rapid convergence to the global 
optimum than others. Section rVIIII discusses how geo- 
metric features of quantum control landscapes indicate 
that certain observable paths may in fact be globally 
more efficient than the gradient flow. Because they do 
not follow the path of steepest ascent, these algorithms 
may require more accurate estimation of the gradient. 
Such methodologies could also be applied to explicit ex- 
perimental tracking of predetermined level set trajecto- 
ries [425. 

In summary, improved methods for the measurement 
of the gradient in the presence of noise, and the accessi- 
bility of control field parameterizations capable of track- 
ing the gradient are the central challenges for implement- 
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FIG. 11: Experimental, unsmoothed quantum control landscape for filtered second harmonic generation (SHG). Four tra- 
jectories are shown; the landscape possesses a single global optimum that may be reached monotonically by the curvilinear 
channels that slice through the landscape. (From ref [3a|.) 



ing experimental control algorithms that exploit the fa- 
vorable topological and geometric structure of quan- 
tum control landscapes. Note that the analytical results 
of Section III pertaining to dominant quantum control 
mechanisms can also be used to help choose appropriate 
control field parameterizations that simplify experimen- 
tal landscape search. 



VI. QUANTUM SYSTEM CONTROLLABILITY 
AND LANDSCAPE STRUCTURE 

As discussed in section II, the full controllability of a 
quantum system is a necessary condition for the nonexis- 
tence of local traps in the control landscape. If the target 
transformation is reachable at the final time T, but inter- 
mediate dynamical propagators are not, the path to the 
target may be plagued with local traps. It is therefore 
important to review the conditions for controllability of 
quantum systems at a fixed dynamical time T. More- 
over, since the choice of T is to some extent arbitrary, 
it is important to identify the possible choices of T that 
lead to full controllability. 

The conditions for the controllability of finite- 
dimensional quantum systems were established [43| 
based upon earlier work on the controllability of systems 



on compact Lie groups [il]. In [i^, an easily imple- 
mentable algorithm for ascertaining the controllability 
of a finite-level quantum system was provided. Consider 
the right-invariant system described by Definition[7] (Ap- 
pendix lA 6[) ; let S be the subgroup of the dynamical 
group G generated by the internal and control Hamil- 
tonians (with corresponding Lie algebra s), and let L 
be the subgroup generated by the control Hamiltonians 
alone (with corresponding Lie algebra I). The follow- 
ing theorem establishes sufficient conditions for the full 
controllability of such systems. 

Theorem 1 Theorem (Controllability of right-invariant 
systems on Lie groups). The reachable set from the iden- 
tity matrix in G is contained in S . If S is compact then 
the reachable set from the identity matrix equals S . In 
particular, if the dimension of the Lie algebra I equals 
the dimension of the ambient Lie group G, and the Lie 
group is compact, then the control system is controllable. 
Furthermore, in this case it is possible to reach any ma- 
trix with an admissible control which is bounded in am- 
plitude. 

Controllability can be checked using the rank condi- 
tion, which states that if the dimension is for the Lie 
algebra spanned by H^, ^li and their commutators such 
as [Hd, Hi], [Hd, [Hd, yUj]], [yU^, [Hd, ^JL^]], etc., then the sys- 
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tern is controllable. This is equivalent to requiring that 
/ be the Lie algebra of all iV x skew-Hermitian ma- 
trices, which in turn is equivalent to requiring that the 
dimension of ^ as a vector space over the real numbers is 
precisely iV^. This criterion for controllability of quan- 
tum dynamical propagators extends to that of states; 
all coherent superpositions of states can be achieved if 
iS* equals U{N). The fact that the controllability of a 
linear control system can be checked via a simple rank 
criterion which, in addition, does not vary from point 
to point, is an important property which is generally 
not valid for a nonlinear control system. Usually this 
condition guarantees only accessibility [i^ . 

A. Exact-time controllability of discrete quantum 
systems 

The above theorem establishes the necessary condi- 
tions for the existence of a time T at which the system is 
controllable, but does not constructively define T. Land- 
scape search would be simplest if the quantum control 
system satisfied the conditions for strong controllability. 

Definition 2 A control system F = {A, Bi,Ui{t)) is 
strongly controllable over a subgroup M if for any T > 
any point of M is reachable from any other point by F in 
T or fewer units of time. A control system is said to be 
strongly controllable if the property of strong controlla- 
bility holds for the entire dynamical group G. A control 
system is exact time controllable at time T if any point 
of M is reachable from any other point by F in exactly 
T units of time. 

Just as there exist analytical solutions to the Pontrya- 
gin maximum principle for finite-dimensional quantum 
systems (i.e., right-invariant systems on a compact Lie 
group), there are also powerful general theorems for es- 
tablishing exact-time and strong controllability of these 
systems. Also by analogy, there are differences in the 
conditions establishing exact-time and strong controlla- 
bility of dynamical transformations versus that of quan- 
tum states. 

For finite-dimensional quantum systems, strong con- 
trollability can be guaranteed if two controls are used, 
and these controls span the whole Lie algebra of the dy- 
namical group. In the more common case of one control, 
strong controllability cannot be guaranteed, but exact- 
time controllability across a wide range of times T can 
be straightforwardly established. 

D'Alessandro and Dahleh [4^ have studied the exact- 
time controllability of two-qubit gates. They showed 



that if a two qubit gate is controllable at time Ti (called 
the critical time) , then it is also controllable at any time 
T2 > Ti. We summarize their proof here because of its 
possible extensions to higher-dimensional quantum sys- 
tems. Let R{T) be the reachable set from /, i.e., the set 
of possible values for X{T) obtained by varying the con- 
trols ui , • • • , u„i within the set of continuous functions 
defined on [0,T]. We also define the sets 

R(< r) = y R{t) (56) 

0<t<T 

]R= y R{t) (57) 

0<t<oc 

Because of right-invariance, R{I,T)S — R{S,T) for ev- 
ery S e SU{2) and every T. Therefore, it suffices to con- 
sider the (exact-time) controllability properties of the set 
reachable from the identity. For quantum systems of ar- 
bitrary dimension, the following theorem establishes the 
existence of a critical time beyond which the reachable 
set R(T) is equal to the entire unitary group U{N) of 
dynamical propagators. 

Theorem 2 fj^]. Let S denote the subalgebra gener- 
ated by the controls A, Bi, ■ ■ ■ , Bm. If {A, Bi, Ui{t)) is a 
right-invariant control system on a Lie group G and S 
is compact, (i) R = S; (ii) There exists a T > such 
that M(< T) = R. 

Powerful exact-time controllability results may be 
proven in dimension 2 because a Lie algebra isomor- 
phism 7 exists between su{2) and so(3). It follows from 
Lie's third theorem f45l|, that p induces a homomorphism 
7' mapping SU (2) onto 50(3). It can be shown that if a 
system is controllable on SO{3), any element of the sub- 
group 50(2) can be reached in arbitrarily small time 
(i.e., the system is small-time controllable on SO{2)). 
It is then straightforward to demonstrate that on either 
50(3) or SU{2), if Ti < T2, then i?(Ti) C i?(T2) and 
therefore R(< T) = R{T) for each T > In other 
words, if Ti < T2, all the points reachable at Ti are 
reachable at T2. Combining this result with Theorem 
m we obtain the the following exact-time controllability 
result in dimension 2: 

Theorem 3 There exists a time Tc, such that R{T) — 
SU{2) for every T > Tc- The critical time Tc is the least 
time such that for every T > Tc, it is possible to drive 
the system from the identity to an arbitrary matrix in 
SU{2). 
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An important question is whether this property can 
be extended to finite quantum systems of arbitrary di- 
mension TV, i.e., whether the above equivalence between 
the sets R and M holds in general. If this is the case, 
quantum control landscapes for larger systems will dis- 
play a homogeneous structure for all T above a critical 
time, such that simulations and experiments need not 
sample extensively over the time T in order to obtain a 
landscape with simple topology. 



B. Controllability of classical and continuous 
variable quantum systems 

For the noncompact Lie groups describing the evolu- 
tion of classical or continuous variable quantum systems, 
strong controllability is not established by the above Lie 
algebra rank condition. This implies that the critical 
topology of control landscapes for such systems may 
change considerably as the final dynamical time T is 
varied, underscoring the comparative simplicity of dis- 
crete quantum control landscapes. 

For continuous variable (infinite-dimensional) quan- 
tum systems, the rank condition is also sufficient for 
establishing controllability on noncompact symplectic 
groups (i.e., those with quadratic Hamiltonians) in the 
common case where Hq is compact, but there is no 
guarantee of exact-time controllability, i.e., some par- 
ticular gates may only be reachable after an extremely 
long time. However, exact-time controllability can be 
achieved at arbitrary positive times (i.e., R{T) ~ K(< 
T) = R ^ U{N) for every T > 0) if we can employ 
two control Hamiltonians that span the whole Lie alge- 
bra of the group of dynamical propagators. Thus, the 
topology of control landscapes for the subset of infinite 
dimensional quantum gates described in section H will 
be largely insensitive to the final time T if two indepen- 
dent controls are used. 

The strong controllability of general infinite- 
dimensional quantum systems (i.e., those with non- 
quadratic Hamiltonians) was studied by Wu and Tarn 
|46j . Such systems were shown to be associated with 
dynamical symmetries represented by noncompact Lie 
groups with infinite-dimensional unitary representa- 
tions. A criterion for approximate strong controllability, 
called smooth controllability, was given, showing that 
such systems, which possess an uncountable number of 
levels, can be well manipulated using a finite number of 
control fields. 

The effects of exact-time controllability of discrete 
versus continuous variable quantum systems on the 



simplicity of control field search were studied by Wu, 
Chakrabarti and Rabitz Fig. [T2l compares the con- 
vergence of optimal searches for achieving the CV SUM 
logic gate (symplectic propagator) versus the computa- 
tionally equivalent discrete CNOT gate (unitary propa- 
gator), using identical gradient-based algorithms. The 
CV gates were implemented using several models with 
varying degrees of controllability, including a weakly 
controllable system (employing ion trap interactions) 
and an uncontrollable system (employing photon-atomic 
spin interactions). As can be seen, the maximal achiev- 
able fidelity is highly sensitive to the choice of final time 
for uncontrollable or weakly controllable systems. More- 
over, even when the gate was reachable, the search effort 
required for convergence was found to increase with de- 
creasing controllability. By contrast, a randomly chosen 
final time was sufficient for achieving near perfect fidelity 
in the discrete quantum system. The weaker controlla- 
bility of continuous systems can also result in control 
fields with more complicated Fourier power spectra, as 
shown in Fig. [131 



VII. COMPUTATIONAL COMPLEXITY OF 
QUANTUM CONTROL LANDSCAPES 

The scaling of the expense of quantum simulation with 
system dimension is of fundamental importance in quan- 
tum chemistry. Similarly, the scaling of the expense for 
quantum control search - either OCT or OCE - lies at 
the heart of the applicability of quantum control to the 
large molecules of practical interest in many applica- 
tions. Whether the search is carried out numerically or 
experimentally, this scaling is referred to as the prob- 
lem's computational complexity. Compared to other 
central optimization problems in quantum technology 
and quantum information, such as state or process re- 
construction the complexity of quantum control 
problems is more difficult to assess since the optimiza- 
tion is carried out over an infinite-dimensional parameter 
space. 

We have seen that analytical solutions to quantum 
optimal control problems appear to exist only for low- 
dimensional systems, and in some cases only for re- 
stricted Hamiltonians. Nonetheless, the existence of an- 
alytical solutions is rare in classical OCT, and begs the 
question of how the difficulty of finding solutions to non- 
integrable quantum control problems increases with sys- 
tem dimension. Of course, this complexity is algorithm- 
dependent. It is also a function of the system Hamil- 
tonian, but may display homogeneous features across 
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FIG. 12: Effects of exact-time controllability on the optimal control fidelity of discrete vs. continuous quantum systems, (a) 
The convergence of control field searches for the 2-qunit continuous quantum SUM gate, with a weakly controllable continuous 
variable system, using conjugate gradient algorithms and different final times, (b) The convergence of optimal searches for 
a 3-qunit SUM gate with a weakly controllable system (photon model), 3-qunit SUM gate with an uncontrollable system 
(ion-trap model) and 3-qubit discrete quantum ControUed-CNOT gate with a standard NMR spin coupling model. See text 
for definitions of quantum gate terminology. (From ref p^.) 



families of Hamiltonians. Recall that in Section III, we 
showed that for certain classes Hamiltonians, analytical 
results pertaining to control mechanisms permits reduc- 
tion in the dimension of the search space. 

The search effort required in OCT calculations for 
observable maximization is remarkably insensitive to 
the dimension of the quantum system. A multitude of 
such calculations have been reported in the literature 
[H) l49l . [soj , on systems ranging in dimension from 2 up 
to more than 10^. Even for the largest systems studied, 
the number of iterations required for convergence seldom 
exceeds 10'^, with most calculations requiring between 
10^ and 10'^ iterations fsil. Is^ . Much larger systems have 
been subjected to OCE studies; in the common case of 
selective bond dissociation, a continuum of states is ac- 
cessed. Nonetheless, the search effort reported in most 
OCE studies is of the same order of magnitude as in 
OCT. 

Since the majority of quantum OCT algorithms are 
based on the gradient of the objective function, and the 
gradient is relatively straightforward to implement in 
OCE, it is natural to ask about the complexity of opti- 
mal control when the search is carried out using these 



algorithms. 



A. Gradient flows and search complexity 

In Section II, we showed how the critical topology of 
the most common objective functions in quantum opti- 
mal control can be determined analytically and display 
features favorable optimal search. In Section III, we es- 
tablished several important analytical results pertaining 
to the geometry of control landscapes, in particular their 
level sets, finding that in certain cases, control mecha- 
nisms can be exploited to reduce the dimensionality of 
the control search space. Here we examine another fea- 
ture of the geometry of control landscapes that permits 
analytical investigation, namely the kinematic gradient 
flows of the objective function <I>. On the domain U{N), 
these gradient flows themselves represent integrable dy- 
namical systems. As a result of this feature, it is possible 
to identify the system-independent contribution to the 
scaling with system dimension of the search effort for 
locating quantum optimal controls. 

The gradient flow is the trajectory followed by the 
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FIG. 13: Comparison of the optimal control fields for discrete and continuous variable quantum gates depicted in Fig. 112b . 
Three independent controls were employed, represented by solid, dashed, and dotted lines, respectively, (a) Optimal fields 
for 3-qunit continuous quantum SUM gate control in a weakly controllable system; (b) Optimal fields for 3-qubit discrete 
quantum ControUed-CNOT gate control in a standard NMR spin coupling model. Control field amplitudes are arbitrary. 
(From ref [H].) 



search algorithm when the algorithmic step is defined 
according to the differential equation 



dU 



(58) 



The unitary gradient flow equations for observable 
maximization and gate optimization are then, respec- 
tively. 



(S), = -C/[p(0),C/tef/], (59) 



^] = w~uw^u 



(60) 



In the case that p(0) has only one nonzero eigen- 
value, corresponding to an initial pure state, it was 



shown that under the change of variables p{T^ s) — 
|V(s))(^(s)|, = (ci(s),--- ,cjv(s)), x{s) = 

(|ci(s)p, • • • , |cAr(s)p), the gradient flow of $i can be 
explicitly integrated to give |43 |: 



x{s) 



(|ci(0)|2,.. .,1^^(0)1^ 



Hci(0)P,. 



) 



2p2s\i 



(61) 
(62) 



where Ai, ■ • • , A^r denote the eigenvalues of 9. The ex- 
plicit solution for the gradient trajectory of objective 
functional $2 was shown to be 

W^'Uis) = (sinh(s) -Fcosh(s)M/^^C/o)- 

• (cosh(s) + sinh(s)VKt[/o)"^ (63) 
where the initial condition is Uq — U (0) [i^l ■ 
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Chakrabarti et al.[53| have calculated upper bounds 
of the convergence times of these unitary gradient flows 
into a ball of radius e around the solution. For the class 
of observable maximization problems above, this bound 
was found to be 



tc,i{H) = max < 



2^ 



, /2Nk 



-2 In 



{N-k- 2)Xk+i 



- Afc+i) 
(64) 

where N is the Hilbert space dimension, k is the degen- 
eracy of the largest eigenvalue of the observable operator 
9 and /i is the absolute value of the difference of the two 
largest eigenvalues of Q. The upper bound on the con- 
vergence time for the unitary gradient flow of the gate 
fidelity function was shown to be 



1 /AN\ 
tcAH) ^ U,2ie) < -ln[-2^j 



(65) 



where a = 



for small e. Since both of these crit- 



1— cos 0Q ' 

ical times scale logarithmically with the Hilbert space 
dimension, the problem of optimizing the objective func- 
tions on the domain of unitary propagators (via gradient 
algorithms) belongs to a logarithmic analog complexity 
class, referred to as CLOG within the analog complexity 
literature fsS]. 

By contrast, the kinematic gradient flows for opti- 
mization of the corresponding objective functions for 
classical or continuous variable systems are not inte- 
grable. The kinematic fiows for optimization of the 
continuous variable SUM gate and the discrete variable 
CNOT gate are shown in Fig. [T3] 24], revealing that the 
kinematic contribution to control optimization is less fa- 
vorable for continuous variable systems. 

The integrated flow derived above for the problem of 
observable maximization applies only to the case where 



p(0) is a pure state. For the more general problem of a 
mixed initial state, analytic solutions are more difficult 
to obtain [43|. However, insight into the scaling of the 
search effort for these problems may be obtained from 
numerical simulations, as well as consideration of the 
dimension of the manifold on which the gradient flow 
evolves. 

As such, numerical optimizations [sH] of the observ- 
able expectation value function on the domain of unitary 
propagators were carried out for p(0) and operators 
of various possible ranks and degeneracies, for Hilbert 
space dimensions ranging from 2 to 40. From a kine- 
matic perspective, the optimization problem is symmet- 
ric with respect to these two operators. It was found 
that the scaling was completely determined by the num- 
ber of nondegenerate eigenvalues of /o(0); in particular, 
if yo(0) is a pure state, the spectrum of 9 does not alter 
the complexity class (or vice versa). In the latter case, 
the scaling of effort was observed to be roughly logarith- 
mic in the Hilbert space dimension, consistent with the 
analytical result above. In the limiting case where p{0) 
is a full rank matrix with nondegenerate eigenvalues, the 
effort was found to scale linearly with system dimension. 

The origin of the observed numerical scaling has been 
probed |22| by examining the dimension of the subspace 
on which the gradient evolves. It is found that this di- 
mension is identical on the domain of unitary propaga- 
tors and control flclds, although in the latter case the 
basis functions change continuously along the optimiza- 
tion trajectory. The gradient can be expanded in terms 
of at most N{N — 1) linearly independent functions of 
the time-dependent dipole operator fJ.{t). Let p consist 
or r subsets of degenerate eigenvalues pi , • • ■ ,Pr with 
multiplicities ni,...,nr, and write p(0) = X]i=i-P«l*)(*l- 
The expression ^ for the gradient from section II can 
be expanded to give 



h^jiT^p^ E [E+ E ]{miT)\j){jHm)-{Mm{j\Q{T)m 



6e(t) .„ 

^ ' k=l i=Sk + l j=l j=Sk+l + l 

+ ]ii2p^ E E {{mT)\j){jHtm-{Mm{mT)m m 

fc=l j=sj. + l j = sj.+l 

I 

where rii are the degeneracies of the eigenvalues pi of p{0), si ~ 0,Sk = J2'i=i ni,k = 2, - ■ ■ ,r + 1, Sr+i = n. 
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FIG. 14: The convergence of the kinematic gradient flows for optimal search of the SUM gate on Sp(4, R) and CNOT gate 
on W(4). (From ref t2J].) 



The terms in the second summation, of which there are 
'^i'nf, add to zero, from which it can be shown that the 
dimension of the subspace of skew-Hermitian matrices 
upon which the gradient flow evolves is [l^l 



D = N^^{N^nf 



n{2N-n) 



(67) 



Therefore, when p(0) is full rank and nondegener- 
ate, the gradient can be expressed in terms of a lin- 
ear combination of N(N — 1) basis functions, irrespec- 
tive of the spectrum of Q. Increasing degeneracy in 
the spectrum of p{0) reduces the dimension of the sub- 
space on which the gradient evolves, such that when p{0) 
has n degenerate eigenvalues, this dimension is equal 
to 2n{N — n). Although this result does not establish 
the kinematic contribution to the scaling of search effort 
with Hilbcrt space dimension, it reveals that the dimen- 
sion of the subspace on which the gradient evolves for 
generic observable maximization problems scales less fa- 
vorably with TV when p and have more nondegenerate 
eigenvalues. 

The existence of a low-dimensional basis set of func- 
tions upon which the gradient can be expanded is espe- 
cially useful given the difficulty of implementing effective 
high-dimensional control field parameterizations in the 
experimental setting (section |V]) . Although this basis 
set varies from point to point along the landscape, re- 
cent work [56] suggests that in many cases, it can be 
remarkably homogeneous, providing a rational means of 
estimating the minimal control parameterization dimen- 
sionality needed to effectively climb the landscape. 



B. Relation between dynamic and kinematic 
gradient flows 

The integrated [/-gradient flows of the observable 
maximization and gate fidelity cost functions identify 
Hamiltonian-independent contributions to the scaling of 
quantum control search effort when using gradient al- 
gorithms. In this section, we derive the Hamiltonian- 
dependent relationship between these [/-gradient flows 
and the e-gradient flows that are followed by OCT and 
OCE algorithms. 

The e-gradient flows are the solutions to the differen- 
tial equations 



de(s, t) 
ds 



= V^{e{t)) = a 



5e{s, t) 



(68) 



where s is a continuous variable parametrizing the algo- 
rithmic time evolution of the search trajectory, and a is 
an arbitrary scalar that we will set to 1. The gradient 
on e{t) is related to the gradient on U{N) through 



(5$ 
fe(i) 



ESUij d$ 



(69) 



Now suppose that we have the gradient flow of e{s,t) 
that follows ([68]) and let U{s), the system propagator at 
time T driven by e(s, i), be the projected trajectory on 
the unitary group IA{N). The (algorithmic) time deriva- 
tive of U(s) is then 



ds 



5U.,,{s) de{s,t) 
5e{s,t) ds 



dt 



(70) 
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which, combined with and ([M]) . gives 



dt/^,(s) 
ds 



SU,,is) ^ SUpgis) d$ 



■E 



Se{s,t) ^ Se{s,t) dUpq 



dt. (71) 



It is convenient to write this equation in vector form, re- 
placing the N X N matrix U (s) with the N'^ dimensional 
vector u(s): 



du(s) 



Su{s) 6u^{s) 
Se{s, t) Se{s, t) 



dt 



[u(s) 



G[e(s,i)]V$[u(s)] (72) 



where the superscript T denotes the transpose. This 
relation implies that the variation of the propagator 
in U{N) caused by the natural gradient flow in the 
space of control field is Hamiltonian-dependent, where 
the influence of the Hamiltonian is contained in the 7V^- 
dimensional symmetric matrix G[e(s,t)]. 

Thus, although the convergence times for the U- 
gradient flows above scale favorably with system size, 
the e-gradicnt flows do not generally follow the same 
paths, and Hamiltonian-dependent effects may dominate 
the scaling when following the gradient on the domain of 
control fields. OCT calculations suggest a difference in 
the scaling of observable maximization and gate control 
search effort when using local gradient-based algorithms 
0] , although the [/-gradient flow scalings are similar for 
these two problems. Systematic dynamical OCT studies 
have been carried out for unitary gate optimization on 
systems of dimension ranging from 2 to 32, using itera- 
tive algorithms. The computational effort was found to 
scale exponentially in the Hilbert space dimension. 

A natural question is whether the Hamiltonian- 
dependent unfavorable scaling of local OCT or OCE 
algorithms can be mitigated by employing global algo- 
rithms whose optimization trajectories are less sensitive 
to the system Hamiltonian. In the next section, we dis- 
cuss such global search algorithms and the properties 
of quantum control landscapes that render these algo- 
rithms effective. 



VIII. GLOBAL SEARCH ALGORITHMS FOR 
QUANTUM CONTROL 

A. Scalar and matrix tracking algorithms 

As shown above, the convergence time of gradient 
OCT or OCE algorithms is dependent on the system 



Hamiltonian. By contrast, it is possible to employ algo- 
rithms that follow a predetermined track of observable 
expectation values, independent of the system Hamil- 
tonian. An efhcient algorithm for following a predeter- 
mined track 



p(s) = (^(s,T)|e|v(s,r)), o<s<i 



(73) 



for the expectation values of a target observable operator 
Q at final time T may be derived from the diffeomorphic 
homotopy formalism described in section IV, originally 
developed for level set exploration. By making the sub- 
stitution ao(s,i,T)^2^di = b{s,T) + in 
equation (j45[) , we obtain the following expression for the 
algorithmic step for the control field (Appendix lA 5|) : 



de{s, t) _ {b{s,T) + ^ - 7(5)) ao{s, t, T) 

/ y^i t) + 



ds 



Tis) 



(74) 

If the Hamiltonian is kept fixed during tracking, 
6(s, T) = 0. As mentioned in section IV, such algorithms 
may also be implemented experimentally, but require a 
precise measurement of the gradient. Analogous equa- 
tions can be derived for following a predetermined track 
of gate fidelity function values. 

At each step in this approach, the observable expecta- 
tion value is specified, but the unitary propagator is not; 
many unitary propagators will map to the same expec- 
tation value. The tracking errors that occur in this ap- 
proach will be system-specific, depending on the system 
dimension and Hamiltonian. The method was applied to 
a five-level quantum system initially in state | 1), with 
the goal of transferring population to state | 5). Figure 
[T5]depicts the changes in the control field along the track 
for P{s) =1 (5 I V(s = 0,T)) |2 -|-sin(27rs). In this case, 
the dipole operator was also morphed along the track, 
in order to demonstrate the feasibility of simultaneous 
Hamiltonian variation. 

It is natural to consider the prospects of tracking 
paths in the space of dynamical propagators, rather 
than observable expectation values. Doing so may per- 
mit a more system-independent definition of quantum 
control complexity. Although this may be difficult to 
achieve in OCE using current technology, it can be eas- 
ily implemented in simulations. Indeed, diffeomorphic 
homotopy provides a natural means of tracking paths 
C/(s,T), < s < 1 in the group of quantum dynam- 
ical propagators. Consider the problem of tracking the 
unitary gradient fiow for observable expectation value 
maximization, integrated in section VII. 
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FIG. 15: (a) Population surface of state | 5) as a function of s and t for the tracking example described in the text {P{s) =\ 
(5 I ip{s = 0,r)) p +sin(27rs)). The elements ^34 and fiu of the dipole operator were simultaneously modulated according 
to /i34(s) = s,^i4(s) = 0.5(1 — s), with other elements kept fixed. At s = 0, the only available direct transition pathway to 
I 5) is I 1) ^1 4) ^1 5), whereas at s = 1 the only possible pathway is ladder climbing through all states. The change of the 
temporal dynamics with s reflects the use of different dynamical pathways throughout the s interval, (b) Cross section of a) 
at time t — T. The calculated observable population follows the imposed track very well. (From ref 



In order for the projected flow from e{t) onto U{T) to 
match the integrated gradient flow on U{T), the quan- 
tity ^^g^'*'* that corresponds to movement in each step 
must satisfy a generalized differential equation: 



following matrix integral equation: 



'^^(s,i)^£Mdi = {/t(s)v$ [[/(.)], (76) 



df/(s) 



SU{s) de{s,t) 



ds Jq Se{s,t) ds 



dt = V$ [U{s)] . (75) 



In the dipole approximation, this relation becomes the 



where /i(s,i) = W {s , t) jiU {s , t) . When $ is the observ- 
able expectation value objective function, we have 



^(s, O^^dt = - [p(0), UHsmis)] . (77) 
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On the basis of eigenstates, the matrix integral equation 
is written 

^ ^^,^{s,t)^^^dt = ih{i\UHs,T)V^ [Uis,T)] 

(78) 

To solve this equation, we first note that the flexibility 
in the choice of the representation of the variation in 
e{s,t) allows us to expand it on the basis of functions 

Hij (s, t) , as 



de{s, t) 
ds 



(79) 



Inserting this expansion into the above equation pro- 
duces 

zh{z\UHs,Tp<i>[U{s,T)]\j) (80) 
If we denote the correlation matrix G(s) as 



Gij^pq{s) 



lllj{s,t)^lpq{s,t)At 



(81) 



{i\ti[s,t)\3){p\ii{s,t)\q)At, (82) 



(as in eqn ([7^ above, but now specifically in the case of 
the dipole approximation) and define 

A,,(s) =ifi(z|f/t(s,T)V$[C/(s,r)]|i}, (83) 

it can be shown [4^.[57j that the matrix integral equation 
(|78l) can be converted into the following A^^-dimensional 
algebraic (nonsingular) differential equation (through a 
procedure analogous to that described in Appendix lA 51 
for scalar tracking): 

|^=/. + («(A)-a)V^(Mt)) (84) 

where fs = fs{t) is a "free" function resulting from 
the solution of the homogeneous differential equation 
(analogous to /s in Appendix lA Sp , the operator v vec- 
torizes its matrix argument (as in eqn (I72|) ') and a = 

jlv{ii{t)) fsdt. This equation is similar to equation 
I A3 1 in Appendix lA 5[ with the notable distinctions that 
the scalar functions ao(s, T), ai(s, T), 02(5, T), 7 and F 
are now replaced by TV^-dimensional vector and A'^'*- 
dimensional matrix counterparts, respectively. 



The computational overhead required for implement- 
ing such unitary matrix tracking, compared to scalar 
tracking, scales (roughly) as N'^, the expense of invert- 
ing the matrix G. However, if this track can faithfully be 
followed, the scaling of the path length and convergence 
time to the optimal control solution could mirror that of 
the gradient flow of the objective function on the domain 
of unitary propagators. In the case of observable max- 
imization, the analysis in the previous section suggests 
that for mixed initial states, the optimization trajectory 
followed by the unitary gradient flow will scale unfavor- 
ably for highly nondegenerate p{0). Importantly, it is 
possible to choose a global path that is even more fa- 
vorable than the integrated unitary gradient flow of the 
gate objective function. Indeed, unitary matrix tracking 
algorithms have recently been developed 57] that follow 
the shortest path between the initial guess and the tar- 
get matrix, namely the geodesic between these points 
in the unitary group. Across a wide variety of target 
gates and system dimensions, these algorithms were ca- 
pable of tracking geodesic paths in U (N) with almost 
negligible error. As the geodesic is the globally optimal 
path in U (N) , this indicates that it may be possible to 
define a system-independent search complexity for quan- 
tum optimal control problems in terms of the scaling of 
the length of the near-geodesic path with Hilbert space 
dimension. 



The ability to track globally optimal paths in U{N), 
originating in the favorable properties of the input-state 
map for discrete quantum systems (below) , may also be 
useful for design of more efficient experimental quan- 
tum control algorithms. In particular, it is possible to 
specify the observable expectation value path that cor- 
responds to the geodesic path in U (N) for a given p(0) 
and Q. Tracking this path experimentally may cause the 
control system to follow a path in U{N) that is glob- 
ally more optimal, and more system-independent, than 
the projected path of the e-gradient, permitting a more 
system-invariant definition of landscape complexity for 
OCE. 



In this approach [42'|, the unitary propagator W that 
maximizes the observable expectation value is first de- 
termined numerically. This can be achieved at minimal 
computational cost if p(0) and O are known. The ob- 
servable track that corresponds to the geodesic U (s) = 
exp {ilog{W'^Uo)s) that connects Uq and W, i.e. (0(s)) 
= Tr (^U{s)p{0)U{s)^Q) , is compatible with an infinite 
number of paths V{s) in U{N), and the set of these 
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paths can be written 

Mt = {V{s) I Tr(l/(s)p(0)F(s)^e) 

Tr([/(s)p(0)C/(s)te) = (e(s))}. (85) 

In order to implement a global OCE search along the 
desired observable track, computational overhead must 
be paid in order to reconstruct the initial density matrix 
of the system. Research in quantum statistical inference 
[ilj has demonstrated that this reconstruction can gen- 
erally be achieved with high statistical certainty at com- 
paratively low cost. As in the case of gradient measure- 
ments, n repeated observations are made on identically 
prepared quantum systems. Each quantum measure- 
ment is described by a positive operator-valued measure 
(POVM) [111. Denoting by the POVM correspond- 
ing to the z-th observation, the likelihood functional 

n 

L{p{t)) =\{TT{p{m) (86) 

i=l 

describes the probability of obtaining the set of observed 
outcomes for a given density matrix p{t). The method 
of maximal likelihood estimation (MLE) maximizes this 
function over the set of density matrices [11]. An ef- 
fective parameterization of p(t) is p{t) = T^T, which 
guarantees positivity and Hermiticity, and the condition 
of unit trace is imposed via a Lagrange multiplier A, to 
give 

n 

L{T) = ^\nTi(T^TF,) - XTt{T^T). (87) 

Standard numerical techniques, such as Newton- 
Raphson or downhill simplex algorithms, may be used to 
search for the maximum over the N"^ parameters of the 
matrix T. Note that other methods for state reconstruc- 
tion, such as the maximum en trop y method or Bayesian 
quantum state identification [4l|, can alternatively be 
used. 

It is possible (and in many cases imperative for good 
results) to constrain the optimization trajectory to fol- 
low still more precise paths in U{N), by specifying 
observable tracks {Qi{s)) corresponding to the desired 
unitary track U{s) for multiple observable operators 
9i. In the limit that the set {0,} constitutes a com- 
plete tomographic set of observables (7V^ — 1 orthogo- 
nal observables 6^), and p{Q) is nondegenerate, the ob- 
servable tracking algorithm becomes effectively identi- 
cal to the unitary matrix tracking algorithm described 
above. For 1 < i < N'^ — 1 observables, the geodesic 



track U (s) is approximated to progressively greater ac- 
curacy, for only incrementally greater cost. Moreover, 
it can be shown [i^] that the k gradients ^^^^^'^^'^ are 
closely related, such that the overhead required to sta- 
tistically sample g^(^f.^ assists in the determination of 

S{&2{T)) Sje^jT)) 
Se(t) Se(t) ■ 

The accuracy with which globally optimal paths in 
U{N) can be tracked depends on the properties of the 
input-state map M : e{t) U{T). In particular, if 
the matrix G is singular or close-to-singular, the track- 
ing errors will be greater and the performance of these 
globally optimal algorithms will be compromised. It 
can be shown that the requirement that G is nonsingu- 
lar amounts to a more demanding form of controllabil- 
ity than full controllability, i.e., from any given unitary 
propagator U{T), it must be possible to track to any 
neighboring U'(T) to first order in s{t). An important 
advantage of (orthogonal) observable tracking compared 
to unitary matrix tracking is that these algorithms place 
less stringent demands on controllability while reaping 
many of the benefits of of following a globally direct path 
to the solution [i^ . 

In the next section, we review properties of discrete 
quantum control systems that render them less likely 
to encounter tracking problems, compared to classical 
control systems. 

B. Extremals of the input-state map 

In section II, we saw that the critical points of quan- 
tum optimal control variational problems that are not 
critical points of the map between control fields and uni- 
tary propagators can be identified analytically. These 
critical points are called normal (or regular) extremals 
in the terminology of control theory. In this section, 
we examine the properties of the so-called input-state 
map e{t) — > U{T) between control fields and associ- 
ated dynamical propagators, comparing to the classical 
case. The critical points of this map are called abnor- 
mal (or singular) extremals of the control problem (see 
Appendix I A 21 for a formal definition). 

Given the simple critical topology of normal extremals 
for quantum optimal control problems, and the integra- 
bility of the gradient flows of the objective functions on 
the domain of dynamical propagators, the properties of 
the input-state map play a dominant role in determin- 
ing the effort required for locating optimal controls. As 
such, the behavior (and design) of advanced search algo- 
rithms for quantum optimal control are largely governed 
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by the properties of this map. 

It can be shown that abnormal extremals correspond 
to control fields s{t) which produce a singular matrix G 
[srj . Because singular extremals correspond to places 
where algorithms that track paths in the space of dy- 
namical propagators break down, their abundance plays 
a central role in determining the maximum possible ef- 
ficiency of optimal control search. 

For general problems of sub-Riemannian geometry 
[soj . abnormal extremals exist in abundance. In par- 
ticular, a dynamical system can be strongly controllable 
and still possess abnormal extremals. For discrete quan- 
tum systems, however, it is possible to prove certain an- 
alytical results pertaining to the existence of abnormal 
extremals that suggest that these extremals are partic- 
ularly rare. 

D'Alessandro and Dahleh |33| gave a complete classifi- 
cation of normal and abnormal extremals for the (single- 
input) optimal gate control problem on SU(2), with 
field fluence as the cost. It was shown that the only 
abnormal extremal in this case is the control e{t) = 
— Tr {Hdn) /Tr (/i/i). For two control fields, if we write 



A := aifii + 02^*2 + 0,3 [a*i,/^2], the only abnormal ex- 
tremal is El = — ai, £2 = —02- For three controls, there 
are no abnormal extremals. 

We sketch the proof of this result for a single control 
field. Recall that in this case, the PMP Hamiltonian 
function for the maximum principle can be written 

/i(M,Ao,e) = Tr[M iUSit){Hd + fie{t))Uom + l^oS^it) 

(88) 

as above, where M again plays the role of the conju- 
gate momentum corresponding to the dynamical propa- 
gator state variable. We first demonstrate that all opti- 
mal controls except e(t) = — Tr (HdfJ-) /Tr (/i/i) are nor- 
mal. It is useful to define [[H^^fi] = ciH^ + 
[[Hd, ^j] , Hd] = diHd + d2fi where C2 = -di, di/ci = 

TT{Hd^l) /TTi^,^i). 

Now, if Aq = (i.e., if the control is an abnormal 
extremal) , the maximizer of the PMP-Hamiltonian must 
satisfy Ti (M,Uo{t)fiUQ{t)) = 0. Differentiating twice, 
we obtain 



cie{t)Tv{MU;{t)HdUo{t)) + x2e{t)Tv {MU^{t)^iUo(t)) + diTr [MU^{t)Uo{t)) + dsTr {MU^{t)iiUoit)) = (89) 

I 



which implies 

(cie(t) + di)Tr {MU;{t)HdUo{t)) = 0. (90) 

It can be shown that e{t) ^ Tr {Hd^i) /Tr (/i/i) implies 
ci +e{t)di ^ 0. Thus, TT{MU^{t)HdUoit)) = 0. It 
follows that M must also equal zero, which contradicts 
the supposition that the minimizer is abnormal. Thus, 
all optimal controls except e{t) ^ Tr {Hdfi) /Tr (fifi) 
are normal. Conversely, it can be verified that s = 
— Tr (ffci, m) /Tr (/X, /J,) satisfies the maximum principle 
with Aq = and M chosen such that Tr (M/i) — 
Tr (M, [Hd, fj]) = 0. This implies that it is an abnormal 
extremal, and since all extremals that are not of this 
form are normal, this is the only abnormal extremal. 
Note that the only abnormal extremal in this case is a 
constant control. For higher-dimensional gate control 
problems using one control field, it can be shown that 
there also exist constant controls that are abnormal ex- 
tremals, although it is not yet clear whether additional 
abnormal extremals exist. 

For the important problem of laser control of popula- 



tion transfer examined in section IIIIBl where the con- 
trol Hamiltonian couples only neighboring energy levels 
(and the internal Hamiltonian can be eliminated), the 
existence of abnormal extremals has been studied for 
discrete quantum systems of arbitrary dimension; in par- 
ticular, for any time t on the domain of a given solution 
to any such state control problem, there exists an in- 
terval [^1 , t^] around t where the solution is not strictly 
abnormal [29|. This property might be termed "weak 
normality" , by analogy to the phenomenon of weak res- 
onance discussed above. 

The need to partition the time domain of the solu- 
tions in this way arises for the same reason as in section 
nil Bl i.e. because the dynamics has singularities when- 
ever a state vector coefficient is zero. For example, if 
"01 = V'2 = 0, the control Vi^2 has no effect on dynamics, 
i-e., Vi_2V'2 — V2,i4'i = 0. In order to prove the property 
of weak normality, one can define a subspace of S*"^^ on 
which the corresponding control problem does not en- 
counter singularities. An auxiliary control problem can 
then be framed on this subspace, which can be shown 
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straightforwardly to possess no abnormal extremals. So- 
lutions to that control problem can be lifted to S"^^ to 
produce normal solutions to the original control prob- 
lem. 

We can accomplish these steps by first defining a parti- 
tion / U J of {1, n} satisfying the following condition: 

J el ^^/jj{t) = Vte[ti,t2] (91) 
j e J ^ ^jj{t) j^O Vt e [ti,t2] . (92) 

In addition, it is necessary to subdivide J into subspaces 
connected by controls, because only in these subspaces 
are the vector fields Fj,k{ip) = Vj,ki^k corresponding to 
the controls identically nonzero. Two indices j, fc of J are 
connected (j ~ k) if there exists a sequence ji, js of 
indices of J such that j ~ ji,k ~ js, and Mr < s, Vj^ 
is a control, i.e. the two energy levels Ej and Ek are 
connected if there exists path through state space where 
successive states are coupled by control matrix elements. 
Denote by Ki, ...,Kr the equivalence classes defined by 
^. Let mi,...,mr denote their respective cardinalities, 
and define Mq = 0, M/ = X]fe</'^fe- F'or convenience, 
we reorder the indices in the partition such that < 
r, Ki = {M/_i + l,...,Mi} and / = {Mr + l,...,n}. 
This simply shifts the indices responsible for singularities 
to the upper end of the spectrum. 

The essential property of discrete quantum state con- 
trol systems that permits proof of weak normality is that 
it is possible to frame this associated auxiliary control 
problem on an analytical submanifold of the domain of 
the original problem, 5'""^. Because X^jeif, I V'i(0 1^ is 
constant on [ti, t2], we can define the analytic submani- 
fold on which ip{t) evolves for i e [ti, in terms of the 
'ipj{ti)s as: 

X = 5™i-i(Ci) X ... X 5™'-i(a) X n{V'j(^i)} (93) 



where Ci — yjJ2jeK, I i^- other words, be- 

cause the subspaces labeled by I are connected by matrix 
elements of the control Hamiltonian, the corresponding 
components of the state vector undergo unitary (state 
vector norm-preserving) evolution on those subspaces. 
It follows that any extremal of the original control 
problem is also an extremal of the auxiliary control prob- 
lem on X, since ip remains the same if the controls Vj^k, 
where at least one of the indices j, k is in /, are set to 
zero. 



It is then straightforward to show [29| that the car- 
dinality of each subspace A; generated by the control 
elements Vj,k with j, k e Ki is equal to the cardinal- 
ity of the Hilbert sphere S''"'~^(C/), and hence that the 
cardinality of A = ©/A/ is equal to the cardinality of 
J. As such, no singularities can exist on this domain 
and the auxiliary control problem has no abnormal ex- 
tremals. We refer the reader to ref [29*1 for details and 
for a discussion of how the normality of solutions to the 
auxiliary control problem is preserved upon lifting to 
gn-i^ Note that the conditions for normality are equiv- 
alent whether the problem is formulated on the space 
of quantum states or unitary propagators. Extending 
these results to the whole domain of the solution is as of 
yet an unsettled question, but this work represents the 
first step in that direction. 

Note that the proofs of these analytical results per- 
taining to the sparseness of abnormal extremals for dis- 
crete quantum control problems make use of the com- 
pactness of the discrete unitary group of dynamical 
propagators. Since this property is not shared by the 
noncompact classical or continuous variable quantum 
dynamical propagators, the more general circumstance 
of abundant abnormal extremals most likely holds for 
those cases. 

Although critical points of the input-state map are 
unlikely to be encountered directly during the search for 
optimal controls, unitary propagators within a certain 
distance of these critical points will be associated with 
nearly singular matrices G, thus possibly compromising 
global tracking efficiency. Current numerical work fo- 
cuses on identifying the radius in U{N) within which 
such ill-conditioned matrices occur, for various families 
of homologous Hamiltonians. 

IX. OPEN QUANTUM SYSTEMS 

Quantum systems of practical interest in chemistry 
or physics are always exposed to some kind of environ- 
ment, which can render the dynamics nonunitary and 
irreversible. Intuitively, environmentally induced irre- 
versible quantum dynamics would seem to downgrade 
the quality of the control outcome. It is therefore im- 
perative to determine whether the favorable features of 
quantum control landscapes, derived in the context of 
ideal closed systems, are preserved in the presence of 
environmental decoherence. In this section, we examine 
the effects of strong decoherence on the critical topology 
of open quantum system control problems. 

The composite of the system and environment obeys 
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the Schrodinger equation: 



^^-^ = [Htotal, Ptotal] (94) 

The composite Hilbert space is 7i = Hs ® Hb, where 
Hs and He are the Hilbert spaces of the system and en- 
vironment, respectively, and the initial state of the total 
system is ptot(O) = ps® Pe- The problem of maximizing 
the expectation value of an observable of the system can 
be expressed in terms of the Kraus dynamical propaga- 
tors of the quantum system in the presence of the 
environment (see Appendix lA 7\ : 



interaction of a system with its environment is domi- 
nated by local interactions, which may be straightfor- 
ward to control. 

We note that the global observable and matrix track- 
ing algorithms described in section IVIIII can be applied 
to open quantum systems as well. In this case, a com- 
plete tomographic set of observables {6i} is composed 
of N"^ rather than N'^ operators [47*1 , thus increasing the 
expense of tracking, but not rendering it prohibitive. 



X. CONCLUSION AND FUTURE 
CHALLENGES 



A 

J{K) = Tr( J2 KranpKl^e) (95) 

m,n— 1 

= Tr{K{p{0)(g)h)KHe(S)h)} (96) 

1 /2 

Using the terminology K — Fe{U) — U{In ® Pe )> 
where C/ is a unitary propagator in U{XN), we can 
lift the landscape topology problem onto the compos- 
ite Hilbert space as 

JpAU) = Ti-{Fp,iU){piO) ® h)Fl{U)&} (97) 
= Tr([/PC/te') (98) 

where P ^ ps ® Pe and 9' — Q ® I\. The compos- 
ite system is assumed to be controllable over U{XN). 
Under this assumption, Wu et al. [60| showed that no 
suboptimal traps exist in the control landscape for max- 
imization of observable expectation values. Moreover, 
the enhanced controllability attainable with open dy- 
namics actually broadens the range of attainable expec- 
tation values. 

Because K [p, N] is homeomorphic to the homoge- 
neous space of U{XN), a landscape mapping satisfying 
the conditions of Theorem 0] can be built from U{XN) to 
K [p, N] . This theorem allows one to extract the critical 
topology of the Kraus landscape in terms of the asso- 
ciated unitary landscape. In particular, since the ob- 
servable maximization landscape for unitary evolution 
was demonstrated to have no suboptimal traps (section 
II), we can immediately conclude that the solution sets 
to open quantum system observable maximization prob- 
lems also have no (normal) traps, assuming the environ- 
ment is controllable. Although the latter condition may 
appear difficult to achieve in practice, in most cases the 



As we have seen, there are stark differences between 
the optimal control landscapes for quantum and clas- 
sical systems. In particular, the geometric properties 
of the compact Lie group of finite-dimensional quan- 
tum propagators endows the corresponding control land- 
scapes with remarkable properties that are considerably 
simpler than those of classical systems'^. Although quan- 
tization of a finite-dimensional classical system generally 
produces an infinite-dimensional quantum system, the 
Hilbert spaces of most quantum systems of practical in- 
terest that possess an infinite number of levels can be ef- 
fectively truncated to finite dimensions. Thus, counter- 
intuitively, locating optimal quantum controls becomes 
in many ways easier than locating corresponding clas- 
sical controls. Given the apparent favorable scaling of 
landscape search complexity with Hilbert space dimen- 
sion, even if distant energy levels play a role in the dy- 
namics, the effort involved in locating controls may still 
be minimal. 

This is most important for the practical feasibility 
of quantum control simulations and experiments on 
large molecules. The scaling of the expense of quan- 
tum dynamical simulation suggests that the computa- 
tional problems inherent in quantum chemistry - high- 
precision electronic structure calculations become pro- 
hibitively expensive for most systems of practical inter- 
est - should be exacerbated for optimal control of such 



^ Formally, the reduction in the dimensionality (hence complex- 
ity) of the search space for discrete quantum controls originates 
in quantum symmetries, as shown in section III. Future work 
may aim to frame this statement within the context of Noether's 
theorem for optimal control, which assigns so-called conserved 
currents to solutions to the maximum principle, based on such 
symmetries. 
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systems. However, the simple features of quantum con- 
trol landscapes described above indicate that optimal 
control search need not add additional complexity to 
these problems. 

The simple topology and geometry of quantum con- 
trol landscapes, moreover, can be exploited to develop 
both numerical and experimental search algorithms that 
may outperform local or adaptive algorithms. The fur- 
ther development of global experimental algorithms is 
of particular interest, as these would take advantage of 
landscape structure without suffering from the exponen- 
tially unfavorable scaling of the cost of quantum simu- 
lation with Hilbert space dimension. 

Although the landscapes for control of finite- 
dimensional quantum systems are thus simpler than 
those for classical systems, the need for statistical infer- 
ence of quantum observable expectation values, states, 
or gradients thereof adds additional overhead to the cost 
of identifying optimal controls in an experimental con- 
text. This overhead is exacerbated when applying global 
algorithms that attempt to take advantage of informa- 
tion regarding the quantum state or dynamical prop- 
agator at each step along the landscape search trajec- 
tory. An especially noteworthy challenge, therefore, is 
the characterization of how the emerging methodologies 
of quantum statistical inference may be employed to fur- 
ther reduce the search complexity of quantum control 
problems. 

The other feature of quantum dynamics that might be 
considered prohibitive to their effective control, namely 
quantum decoherence, was shown to not have a signif- 
icant effect on some of the most important properties 
of optimal control landscapes, in particular their critical 
topology. Future work should more thoroughly explore 
how the geometry of the control landscapes and the ef- 
fectiveness of global search algorithms are affected by 
noise, the nonunitary evolution of incoherent quantum 
dynamics, and measurement. 



APPENDIX A: MATHEMATICAL APPENDICES 
1. Critical topology 

a. Landscape mapping 

Theorem 4 Suppose the function x = f{y) is locally 
surjective near some point yo G Y, i.e., the Jacobian 



has full rank: 

rank ^ \y=y^^ dim X U=f(^y„) 

in some local coordinate system. Then j/g is critical for 
L o f in Y if and only if Xq = f{ya) is critical for L 
in X, and they have identical numbers of positive and 
negative Hessian eigenvalues at yo and xq, respectively. 
Moreover, if the inverse image f~^{xo) of every critical 
point Xq is connected, then the connected components of 
their critical manifolds are one-to-one between the two 
landscapes fddl l. 

b. Hessian quadratic form,: observable maximization 

On the domain of unitary propagators, the Hessian 
quadratic form (HQF) for observable maximization can 
be written 

Ha{U) = Tr [-4AV(0)C/e[/^ + 4Ap{0)AUQU''] 

at a unitary matrix U, expanded along an arbitrary di- 
rection A in the Lie algebra of U{N). Consider a par- 
ticular solution Ui that generates orderings Xj —^ 7r;(Aj) 
of the eigenvalues of O, where the array ni specifies an 
N-index permutation mapping. If we define the matrix 
elements of A as Aij = Uij -\-iBij, we obtain after some 
straightforward calculations [l3| 

UAiUi) ^-Y,{a%+I3%) [(A.(j) - A4fc))(e, - e,.)] 

from which the counting results presented in section II 
can be derived. The number of positive principal axis 
directions equals the number of {j, k) pairs for which 
{Xj — Xk){ej — ek) ^ 0, and the number of negative prin- 
cipal axis directions equals the number of (j, k) pairs for 
which (Aj - Afc)(ej - efe) < 0. 

2. Maximum principle and adjoint control systems 

Theorem 5 (Pontryagin maximum principle) Consider 
the problem of steering the control system 

X = /(x, u), X € M, ueil C R'', 

where M is the state space of the system, from some 
initial state x{0) = Xq to some final state Xi while 
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minimizing a cost of the form f'^{x,u)dt. The 
maximum principle states that if the couple u{t),x{t) 
is optimal, there exists an absolutely continuous vec- 
tor X(t) G M" and a constant A < 0, such that 
the PMP-Hamiltonian function h{x{t), X(t),u{t)) = 
{X{t),f{x{t),u{t)))+Xof''{x{t),u{t)) satisfies 



h{x{t), X{t),u{t)) — maXuh{x(t),X{t),u) 



and 



X,{t) 



dh 

dxi 



j e 1, . 



Moreover, denoting the tangent space to the manifold 
M at state x{t') by T^^t')M, we have (A(0)^(o)M) = 
(A(T), Tj-cr-jM) (transversality condition) \22j- If the 
final time T is fixed, h{x{t),X(t),u{t)) is constant, 
whereas if T is allowed to vary, h{x{t) , X(t) , u(t)) = 0. 

// the control objective is to minimize the final time T 
instead of a cost of the form above, the optimal trajec- 
tory on [0, r] is associated with the Hamiltonian — Aq + 
{X{t), f{x{t),u{t)). In this case, maXuh{x{t),X{t),u) = 
in [0,T], and we have the additional condition that if 
Aq = 0, then X{t) ^ for any t X'l- 

Definition 3 (Normal, abnormal extremals) A trajec- 
tory x{t) satisfying the above condition is called an ex- 
tremal. If Aq = 0, it is called an abnormal extremal; if 
Xf) < 0, it is called a normal extremal. If an extremal is 
abnormal but not normal, it is called a strictly abnormal 
extremal. 

Definition 4 (Adjoint control system) Consider the fol- 
lowing control system F on a Lie group G: 



Ha 



ih 



u. 



Let K denote the subgroup spanned by the control Hamil- 
tonians fij, and denote the adjoint orbit of —iHd (the 
internal, or drift Hamiltonian) under the action of 
the subgroup K by Adpci—illd), i.e. AdK{~iHd) — 
{k\{—illd)k\\k\ G K}. Then the adjoint control sys- 
tem of F is defined as the system P = TiP, Ti e 
Adxi—illd), P G G, which evolves on the coset space 
G/K fSj. 

Definition 5 (Infimizing time) For the control system 
F above, let R{I , t) denote the reachable set from the 
identity in time t. Then t*{UF) = inf{t > 0\Uf G 
R{I,t)} is called the infimizing time for producing the 
propagator U f ■ 



Theorem 6 (Equivalence theorem) The infimizing time 
t*{UF) for steering the system 



U 



Hd 



J2 UiHj 
i=i 



U 



from U{Q) = I to Uf is the same as the minimum coset 
time L*{KUf) for steering the adjoint system 

P = HP, HeAdxiHd) 
from P{0) ^I to KUf 0/. 

Theorem 7 (Adjoint maximum principle) For the 
above adjoint control system, denote the time-optimal 
control law by 7i{t) and the corresponding optimal tra- 
jectory by P{t). Define an adjoint auxiliary cost func- 
tion, f{P) = Tr(A^7iP), PX^ G p. The correspond- 
ing adjoint PMP-Hamiltonian is h{P{t),X{t),'H{t)) ~ 
TT{X^t)nit)P{t)) = TT{N{t)nit)). The optimal ad- 
joint control-trajectory pairs are then the solutions to 
the Hamiltonian equations — = —§p — 'H{t)X{t). 
The adjoint maximum principle 0/ demands that there 
exists a N(t) G p (directions in G/K space) such that 

n{t) = argmax^TT{nN{t)), H G Adxi-iHd) 



dm 

dt 



= n{t)p{t) 



dN{t) 
dt 



= [m,N{t)] 



3. Rotating wave approximation 

The rotating wave approximation (RWA) consists of 
a unitary change of coordinates (and controls) by which 
the internal (drift) Hamiltonian can be eliminated in 
problems involving atom-electromagnetic wave interac- 
tions, by virtue of the electromagnetic radiation being 
nearly resonant, or where the interaction Hamiltonian 
couples only neighboring states [1^. We consider the 
latter case. Let ip{t) = U{t)tp'{t). Then the state 
vector in the rotated coordinate system satisfies the 
Schrodinger equation: 



d^'(t) 
' dt 



H'm'it) 
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where the Hamiltonian in the rotated coordinate system 
is 

H' = U-'HU-iU-' — . 

dt 

In order to ehminate the internal Hamiltonian, we 
choose U{t) = exp{-iDt); since H = D + V{t), H' = 
iUDW + U{D + V{t))W = cxp{iDt)V{t)exp{-iDt). 
Redefining ip' ip and H := —iH', we have 

^ = mt)m, 

where H is skew-Hermitian. The elements of this Hamil- 
tonian are either zero or are controls; as such, the drift 
is eliminated. Assuming that the control Hamiltonian 
V is off-diagonal (i.e., Vij = only if i — j ± 1), the 
relation between the original and "new" controls Hj^k{t) 
is: 

V,^k{t) = H,^k{t) exp(i [{Ek - E,)t + 7r/2]). 

In the more general case where the control Hamiltonian 
is not off-diagonal but the control fields are assumed to 
be roughly in resonance with the system transition fre- 



l 

P 
h 

Decomposing the target unitary propagator as Up — 
fc2exp(y)fci, (section [hi Cp . we have 



Up = ki exp [-i{aiIa:Sx + a2lySy + aa/^S'^)] k^, 

fci,fc2 e SU{2)®SU{2), 

where the sub-Riemannian problem consists of gen- 
erating exp(y) in the fastest possible way. If we 
define fc~ — exp(— z7r/2/j,) exp(— i7r/2S'j^) and fc+ = 
exp^in /2Iy) exp(—iTT/2Sy), we can verify that 

fc± exp(-i/,5,)(fc±)-i = expi±iI,S^) 

and similarly for k^-, showing we can generate any ele- 
ment of the Cartan subalgebra h. 



quencies, the transformed Hamiltonian takes on a simi- 
larly simple form under the approximation that rapidly 
oscillating terms average to zero. 



4. Analytical solutions to state and gate control 
problems 

a. Low- dimensional gate control problems 

Consider the right-invariant control system described 
in Definition 4. Following section IIII C[ let G denote 
the special unitary group SU{N). Call the subalgebra 
generated by the controls {/ii, and the corre- 

sponding subgroup K. If we decompose G = p ® I such 
that p is orthogonal to I, then p represents all possible 
directions to move in G/ K space. Denote by /i C p a 
subspace of maximally commuting directions or genera- 
tors in G/K. 

Specifically, in the case of two-qubit systems, G/K — 
SU{4)/SU{2) SUi2), g = s'a(4), and K = S'C/(2) ^ 
SU{2). In this case, it can be shown that the Lie alge- 
bras l,p, and h are 



I 

In the case of three spins coupled by local interactions 
such that Ji2 — J23, J13 = 0, G/iiT is a nonsymmetric 
space, but is still a finite-dimensional Riemannian man- 
ifold. Khaneja and coworkers Q considered the genera- 
tion of unitary propagators of the form 



U = exp(-i6'/iQ/2/3/3^), a,P,j e {x,y,z}, 

which are hard to produce as they involve trlinear terms 
in the effective Hamiltonian (trilinear propagators). Ap- 
plying the decomposition Up = k2exp{Y)ki, it is suffi- 
cient to produce 



exp(r) = exp{-tehJ2^h.): e [0, 47r] 



I 

= span i{Ix,IyJ^,Sx,Sy,Sz} 

— span i{lxSxT IxSy, IxS z, lySx, lySy, lyS zt I zSxt I zSy, IzS z 

= span i{IxSx,IySy,IzSz}. 
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because all other propagators belonging to the set 
exp(— i6'/io,/2/3/37|a,/3,7 S {x,y,z}} of trilinear prop- 
agators can be produced from J7f in arbitrarily small 
time by selective hard pulses. 

The corresponding adjoint control problem (Definition 
HI) has H e AdK{-i2TTj{Ii^I2z + hzhz))- For adjoint 
control problems, an equivalent version of the Pontrya- 
gin maximum principle exists (Appendix I A 2[) . It can be 
verified [9] that the following analytical time-dependent 
control satisfies this principle: 

n(t) = -i2T:J- 
■ [ihzhx + hxhz cos( - {hzhy + hyhz) sin(^)] 

and steers the adjoint system from P(0) = / to P{T) e 
KUf in minimal time. The minimum time t*{UF) 
required to produce a propagator of the form Up — 
exp{—i9Iizl2zl3z), 6 £ [0,47r] is then given by 



2J 



where k = 9/2tt. 



h. Low- dimensional state control problems 

Analytical solutions to problems of state-to-state pop- 
ulation transfer can be obtained for two- and three-level 
quantum systems, for off-diagonal control Hamiltonians 
(i.e., Vjk = if 7^ fc ± 1), under the rotating wave 
approximation (Appendix I A 3|) . We summarize the re- 
sults for the optimal control of population transfer in 
three-level systems using fluence as the cost, with two 
controls that span the control Lie algebra [1^ , since this 
provides an example for how objective function symme- 
try can endow integrability to quantum control systems 
and more generally simplify the search for optimal con- 
trols. Let us consider the problem of transferring the 
population from pure state | 1} to pure state | 3), with 
Ml, 12 = M2,2i = 1, M2,i2 = M2,2i = 1- The Schrodinger 
equation for the Hamiltonian in this case can be written 



X5+ia;+6, we can write this concisely as i = £ii^i+e2-F2, 
where x = {xi,...,xq) and Fi = (— 2:3, — X4, si, a;2, 0, 0) 
and F2 = (0, 0, 2:5, xq, —X3, —X4) denote the action of the 
control Hamiltonians /zi and /X2 on the state x. This is 
a problem on the 5-dimensional Hilbert sphere, . The 
initial condition for this problem is a point on the cir- 



cle Si ^ {x G 55 



is a point on the circle = {x G S*' 



= 1}, whereas the target 



However, the dimensionality of this problem can be re- 
duced if we assume that the controls are resonant (sec- 
tion |TTTB|). In this case, for each Xq G SL the orbit 
O(xo) (the reachable set of states) is a two-dimensional 
submanifold of S*^, and hence the system is not fully 
controllable (i.e. not all superpositions of states can 
be reached from arbitrary initial conditions). Nonethe- 
less, arbitrary eigenstate-eigenstate transitions can be 
controlled. Let us define Xo(a) as the initial condition 
xi(0) = cos(q:), 2:2(0) = sin(a), a G [0, 27r]. Then 
this submanifold is the two-dimensional sphere defined 
by the equation x'l -\- x'^ + x'^ = 1, where x' = i? (g) /3X. 
In other words, due to the isometry, all the points in Sin 
can be considered equivalently. Therefore, we can study 
the optimal control problem on the orbit 0(xo). Let us 
consider the case where xp is defined by 2:1 = 1; in this 
case, O(xo) is the sphere defined by x\-\- x\a- x^ — 1. 

We can then execute a change of variables to yi — 
Xi,y2 = X3, 1/3 = —X5, such that the control system can 
be rewritten as 












U1F1+U2F2; Fi = 1 














K y2 / 



It is useful to frame the reduced problem in spherical 
coordinates, where 



2/1 

2/2 
2/3 



cos(6') cos(0) 
sin(6') 

cos{0) sin(0). 



The control system can then be written 



Vld + V2G2, 



Cl = -iei{t)c2, 

C2 = -i{ei{t)ci + e2{t)c3), 

C3 = -iU2{t)c2, 

where Ci denote the coefficients of the wavefunction 
eigenstates Xi. If we set ci = 2:i-|-i2;2, C2 = x^ — ix^, C3 — 



where Gi = dg, G2 = ta.n{9)d^. 

In spherical coordinates, the Hamiltonian associated 
with the maximum principle is 



h{9, (l),Fe,P4„ vi,V2) 



{P,viGi+V2G2) +Po{vl+vl) 
viPe + V2P4,ta.n{e) + po{vl 



vl) 
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The maximum principle demands — 0, = 0; as 

such, vi — Pg, W2 = P^tan{6). The Hamiltonian cor- 
responding to these controls is h = \ {Pg + (tan(6')P0)^). 
The Hamiltonian equations of motion following from the 
maximum principle are then: 



dh 

m 



dh 



P^t&n^ie) 



dF{s) _ A{Q{s))j 



ds 



= 



In the following, we use the subscript + to refer to a 
point infinitesimally close to the system at point s. The 
interaction dynamical propagator in the interaction pic- 
ture can then be written Ui{t,G) = W {t,0)U+{t,0). To 
first order, the interaction picture propagator at the final 
time T is: 



tan2(0)), P^ = -^ = 0. 



This Hamiltonian system is Liouville integrable, since 
there are two independent and commuting constants of 
the motion h and P^ = a. The solution for minimal 
fluence, with fixed transfer time T can then be shown to 
be fH: 



[ei + ei)dt 



3 , 1 

4 T 



Uj{T,0) = I+^J^ dt{uHt,0) 



dH{s,t) 



C/(t,0)) 



If we Taylor expand the Hamiltonian to first order at 
algorithmic time s, i.e.. 



H+{s, t) = H{s + ds, t) = H{s, t) + ds 



dH{s,t) 
ds 



the expectation value of the observable of interest at the 
point s -f ds in Hamiltonian space can be expressed as: 



5. Diffeomorphic homotopy on control landscapes 

We sketch the derivation of the general diffeomorphic 
homotopy procedure for Hamiltonian morphing and ob- 
servable tracking jsi], [H, [s^ . The condition for remain- 
ing on a designated level set of an observable control 
landscape is 



{Q{s + As))t = {Q[s))t + 

|(V.ol^''rft[e(T),c/t(i,o)^^Ji^[/(t,o)]|Vo). 

(Al) 

It can then be shown that the condition for remaining 
on the level set can be written 



^^ = 1 dt{ao{s,t,T)^^^+a,is,t,T)eis,t) + a2is,t,T)) ^0, (A2) 

where 

ao(s,t,r) = -l(^o|[C/t(T,0)eC/(T,0),C/t(t,0)A*(s)[/(t,0)]|7Ao) 

ai{s,t,T) = -l(^o|[C/t(T,0)eC/(T,0),C/t(t,0)^;7(i,0)]|^o) 
in ds ■' 

a2is,t,T) -l.{r[,,\[uHT,0)eU{T,0),U\t,0)^^^U{t,0)]\iJo). 



A natural way to solve eqn (|A2[) is to transform it into an initial value problem for the laser field e(s, t). Equa- 
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tion (jA2[) can be reexpressed as the differential equation 
ao{s,t,T)^^^^+ai{s,t,T)e{s,t) + a2{s,t,T) = f{s,t) 

where f{s,t) is an arbitrary function satisfying the con- 
straint 



/ f{s,t)dt = Vs. 
Jo 



In general the coefficient ao{s,t,T) may vanish at some 
values of s and t. Since there are a priori no restric- 
tions on ao(s,t, T), we cannot preclude the possibility 
of singular behavior with the class of D-MORPH con- 
trols admitted by equation (jA2p . Singular behavior is 
unattractive because it implies the possible existence of 
similar undesirable behavior in the control field e. Re- 
gardless of the behavior of Cq, a nonsingular class of 
D-MORPH solutions may be generated. Defining the 
integral 



b{s, T)^~ [ (ai(s, t, T)e{s, t) + 03(5, t, T))dt, 
Jo 



we have 



ao{s,t,T) 



de{s, t) 
ds 



dt = 5(s,r), 



which is a Fredholm integral equation of the first kind. 
More generally, in the case that following a track of ob- 
jective function values (6(s)) is desired, instead of re- 
maining on a level set, we have 



ao(,s, t, 1 ) — dr = o(s, 1 ) + 



ds 



ds 



Then, it can be shown [31] that this equation can be 
transformed into the equivalent (nonsingular) differen- 
tial equation 



de{s,t) , , (6(s,T) + ^iMM»-7(^))ao(.,t,T) 



ds 



r(s) 



(A3) 

where r(s) = [ao(s,i,T)] dt and j{s) = 

ao{s,t,T)f{s,t)dt is the projection of the arbitrary 
function /(s, t) onto ao(s, t, T) (the above expression can 
be multiplied by an arbitrary shape coefficient S(t)). 



The freedom to choose /(s, t) corresponds to the mul- 
tiplicity of control field solutions on the level set, and 
arises naturally as a consequence of the underspecified 
nature of the integral form of the original D-MORPH 
equation. In particular, in the case of fluence minimiza- 
tion, /(s,t) = fm{s,t) satisfies the condition 



It can be shown [sT] that with the choice 



f{S:t) 



1 £{s,t) 
As S{t) ' 



the algorithm seeks to minimize the total field fiuence 
at each step. Analogous free functions that correspond 
to other auxiliary costs (such as minimal time) in the 
Pontryagin maximum principle can be constructed. 



6. Controllability on compact Lie groups 

Definition 6 (Reachable sets and controllability) Con- 
sider a control system F defined on a manifold M . For 
each T > 0, and each xq in M , the set of points reach- 
able from at time T , denoted by A{xq, T), is equal to 
the set of terminal points x{T) of integral curves of F 
that originate at xq. The union of A{xf),T), for T > 0, 
is called the reachable set f2^ ] from xq- The set of points 
reachable in T or fewer units of time, defined as the 
union of A{xo,t), t < T, is denoted A{xo,< T). A 
control system F is controllable if any point of M is 
reachable from any other point of M , at any time T > 0. 

Definition 7 (Invariant control system on a Lie group) 
A control system on a Lie group G, where G is the Lie 
group associated with a Lie algebra h, is defined by the 
equations 

m 

U^AU{t) + Y,u.^{t)B,U{t) 

i=l 

where A and the Bi, i = I,-- - ,m belong to h, U{t) 
belongs to G, and the Ui(t) are scalar functions of time 
which play the role of the external controls. The control 
system is said to be right-invariant if the following con- 
dition holds: If U{t) is a solution corresponding to the 
initial condition equal to the identity matrix, the solu- 
tion corresponding to the initial condition F is given by 
U{t)F. 
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7. Kraus superoperator formalism 

Consider a composite of system and environment 
whose Hamiltonian Htotai consists of the Hamiltonians 
of the system, environment, and their interaction. The 
total system evolution operator is Utotai{t) on the to- 
tal Hilbert space Ti = 7is He, where Hs and He 
are the Hilbert spaces of the system (of dimension N) 
and environment, respectively. The initial state of the 
total system is ptot{0) — Ps ® Pe- We can obtain an 
expression for the system dynamics ps{i) by tracing 
Ptotai{t)_= Utotai{t)ptotai{0)Ul^^^i{t) ovcr the environ- 
ment [63|: 

Psit) = TTEiUtotaimps ® PEWl^Jt)} 

Define the AA^-dimensional matrix K{t) = 

TTE{Utotai{t){lNpT)- Divide K into N x N 
matrices Kap{t) = |/3}(a|)}, (a,/3 = I,-- - ,A), where 
a, (3 constitute an arbitrary basis for He- These ma- 
trices form the Kraus representation of the dynamical 
map as 

A 

ps{t) = K^p(t)p{Q)Kl^{t). 

a, 13=1 

8. Symplectic propagators 

Consider a continuous variable quantum system with 
a quadratic Hamiltonian H{t). H{t) induces a Hamilto- 
nian vector field, which generates a one-parameter fam- 
ily of transformations U{t) on the Hilbert space H that 



obeys the Schrodinger equation 

where the parameter is the time. The evolution propa- 
gator transforms the quadrature vector of position and 
momentum operators z = (gi, • • • , qN',Pi, ■ ■ ■ ,Pn)'^ lin- 
early through 

U : ^ U^{t)z^Uit)^J2So,f3{t)z0, 



where the 2N x 2N matrix S{t) is an element of the 
symplectic group Sp(2A'', M) that satisfies S'^JS — J, 
with 



Thus, the matrix S captures the Heisenberg equations 
of motion for the operators Zi, and the unitary propaga- 
tor U forms the metaplectic unitary representation of S 
in Sp(2iV, R) |6li|. Like the infinite-dimensional unitary 
group (but unlike the finite-dimensional unitary group) , 
Sp(27V, R) is noncompact. 

Whereas a logical operation on N discrete quantum 
bits (qubits) is represented by a 2^-dimensional uni- 
tary matrix, the corresponding operation on N continu- 
ous quantum bits (qunits) can be represented by a 2N- 
dimensional symplectic matrix. 
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